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Figure 6 
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Figure 7 


Integrated GPS/IMU/Camera Configuration for the AERCam 
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FIG. 8 
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FIG. 9 
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Fully-Coupled GPS/IMU Integration 
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FIG. 12 
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mage Feature Extraction 
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Attributed Graph Representation 
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FIG. 24 
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Master/slave velocity errors m/sec 

Master/slave attitude errors rad 

Accelerometer bias m/sec 

Scale factor and ali gnment error ppm 
Nonlinear sensitivity 1 /m/sec 2 

Gyro bias & rad/sec rat/sec 

Scale factor and nonlinearity ppm 


FIG.29 (Table 2) 
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Linear State Model 

*0) = F(0*(0 + G(0>F<0,»'(0 = N{Q,Q{t)}andX(0)= N{X 0 ,P 0 ) 

Linear Measurement Model 

Z(t) = H(t)X(t) + Vft) 

where 

X(t) - State vector 
F(t) = State matrix 
G(t) = Process noise matrix 
fP(/) = Zero mean white Gaussian noise 
Q(t) « Covariance matrix of state noise 
Z(/) * Measurement vector 
H{t)~ Measurement matrix 
P(f)- Zero mean white Gaussian noise 
R{() = Covariance matrix of measurement noise 
*(0) = initial state values 
Xq ~ Initial state error covariance 
State and Error Covariance Propagation: 

X(l t //*_,)- //*.,),^(0/0) = X 0 andP(OfO) = P 0 

POk “ GK.tk 1 ! h-\)®i.tk’*k-\) T 

+ll i W k ,T)G{T)&T)G(T) T <Ktk,*j r dT 

State and Error Covariance Updating; 

X{t k /t k ) = X(t„ /(*_,)+ (/* )[Z(/, ) - H(t k )X(i k / r ) 

nt k it k )~{\-K{t k )H{t k mt k it k _,) 

Kalman gain matrix 

K(t k )=p( tk I i k _,mt k Ymt k )P{t k h k . x )H(, k ) T +R{t k ))- 1 

where 

X(t k ! h- 1) = Propagated state estimate 

P(t k / ft-) )~ Propagated error covariance matrix 

X{t k f t k ) = State estimate 

P(t k / t k )= Error covariance matrix 

gC u. t )~ State transition matrix 


FIG.30 (Table 3) 
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MINIATURIZED GPS/MEMS IMU 
INTEGRATED BOARD 

CROSS REFERENCE OF RELATED 

APPLICATION 5 

This is anon-provisional application of a provisional appli- 
cation having application No. 60/880,345 and filing date of 
Jan. 12, 2007, and is a Continuation-In-Part application of 
application Ser. No. 10/912,401 filed on Aug. 4, 2004 now 10 
U.S. Pat. No. 7,376,262. 

This invention was made with Government support under 
contract NAS9-99024 awarded by NASA. The Government 
has certain rights in the invention. 
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BACKGROUND OF THE PRESENT INVENTION 

1. Field of Invention 

The present invention relates generally to machine vision 
systems, and more particularly to object positioning, which 20 
employs electro -optic (EO) image sensors enhanced with 
integrated laser ranger, global positioning system/inertial 
measurement unit, and integrates this data to get reliable and 
real time object position. 

2. Description of Related Arts 25 

There are two difficult problems for machine vision sys- 
tems. One is image processing speed, another is the reliabil- 
ity, which affect the application of electro-optic image sen- 
sors (e.g. stereo cameras) to robotics, autonomous landing 
and material handling. 30 

The match filter takes long time to match different orien- 
tation and size templates to detect certain object. In the 
present invention, the electro-optic image sensor imaging 
system derives the electro-optic image sensors’ attitude and 
orientation data from a global positioning system/inertial 35 
measurement unit integrated navigation system for the tem- 
plate rotation. The electro-optic image sensor image system 
derives the object range data from a laser ranger for the 
template enlarging/ shrinking . 

40 

SUMMARY OF THE PRESENT INVENTION 

It is a main objective of the present invention to provide 
electro-optic image sensor positioning using feature match- 
ing thereof, in which three dimensional object positions can 45 
be calculated and determined. 

Another objective of the present invention is to provide a 
universal object positioning and data integrating method and 
system thereof, in which the electro-optic image sensor imag- 
ing system derives the electro-optic image sensors’ attitude 50 
and orientation data from a global positioning system/inertial 
measurement unit integrated navigation system for the tem- 
plate rotation. 

Another objective of the present invention is to provide a 
universal object positioning and data integrating method and 55 
system thereof, in which the electro -optic image sensor image 
system derives the object range data from a laser ranger for 
the template enlarging/shrinking. 

Another objective of the present invention is to provide a 
universal fiducial feature detection method and system 60 
thereof, in which the autonomous object positions can be 
calculated and determined by matching fiducial features in 
both images. 

Another objective of the present invention is to provide a 
universal comer detection method and system thereof, in 65 
which the autonomous object positions can be calculated and 
determined by matching comers in both images. 
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Another objective of the present invention is to provide an 
object identification method and system thereof, in which the 
detected three dimensional comers and fiducial features are 
grouped for object identification. 

Another objective of the present invention is to provide an 
object identification method and system thereof, in which the 
grouped comer and fiducial features are combined with line 
detection and circle detection for complex object detection. 

Another objective of the present invention is to provide an 
intelligent automated system to realize autonomous naviga- 
tion with capabilities to perform highly precise relative atti- 
tude and position determination, intelligent robust failure 
detection and isolation, advanced collision avoidance, and 
on-board situational awareness for contingency operations. 

Another objective of the present invention is to provide an 
intelligent automated system thereof, in which two naviga- 
tion cameras are utilized to measure the range and range rate. 

The key to electro-optic sensors image processing is to 
determine which point in one image corresponds to a given 
point in another image. There are many methods that deal 
with this problem, such as the correlation method, gray level 
matching and graph cut. These methods process all of the 
image pixels for both electro-optic image sensors. Some of 
the methods need iteration until convergence occurs. Pixel 
matching is time consuming and unreliable. Actually only the 
feature points can be used for positioning. Points, comers, 
lines, circles and polygons are four types of image features. 
Comers and fiducial features are selected for processing. 

Image segmentation is an essential procedure to extract 
features from images. For the segmentation, the high pass 
filter is used to segment an image. To improve the results of 
segmentation, a smoothing preprocessing operation is pref- 
erable. In order to preserve edge information in a smoothing 
procedure, the low pass filter is used at the preprocessing 
stage. 

Because the fiducial features can be consistently detected 
in the images, the same features can be found in both images 
correctly by processing electro-optic sensor images and 
matching features on both images. The disparities (i.e., range) 
to the fiducial features can be easily computed. 

A comer is another kind of feature, which exists in most 
kinds of objects. Comer detection utilizes the convolution 
between the original image and a comer mask, so it can be 
implemented in real time easily. The same corners can be 
found in both images, correctly, by processing the electro - 
optic sensor images and matching corners in both images. 
The disparities (i.e., range) to the comers can then be easily 
computed. 

The present invention can substantially solve the problems 
encountered in machine vision system integration by using 
state-of-the-art inertial sensor, global positioning system 
technology, laser ranger unit enhanced with fiducial feature 
matching and comer matching technologies. The present 
invention is to make machine vision a practical application by 
enhancing real time and reliability. 

These and other objectives, features, and advantages of the 
present invention will become apparent from the following 
detailed description, the accompanying drawings, and the 
appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of an image-processing module, 
which is composed of EO sensors, a MEMS IMU, GPS 
receiver, laser ranger, preprocessing module, segmentation 
module, detection module, recognition module, 3D position- 
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ing module and tracking module, according to a preferred 
embodiment of the present invention. 

FIG. 2 is a block diagram illustrating the preprocessing 
module according to the above preferred embodiment of the 
present invention. 

FIG. 3 is a block diagram illustrating the segmentation 
module according to the above preferred embodiment of the 
present invention. 

FIG. 4 is a block diagram of the detection module accord- 
ing to the above preferred embodiment of the present inven- 
tion. 

FIG. 5 is a block diagram of the recognition module 
according to the above preferred embodiment of the present 
invention. 

FIG. 6 is a block diagram of the tracking module according 
to the above preferred embodiment of the present invention. 

FIG. 7 is a coordinate systems definition for the 3D-posi- 
tioning module according to the above preferred embodiment 
of the present invention. 

FIG. 8 is a block diagram of the GPS/IMU/Camera navi- 
gation structure. 

FIG. 9 is a block diagram of the intelligent autonomous 
relative navigation using multi- sensors. 

FIG. 10 illustrates the top level diagram of the proximity 
sensing system that incorporates dual video cameras mounted 
on rotating platforms at the poles of the AERCam 1*. The 
video cameras rotate in a synchronized fashion to generate 
stereo images that provide 360 degree coverage about the 
AERCam V. Range and range-rate estimates are derived from 
the image data. 

FIG. 11 is a block diagram of the AGNC’s fully coupled 
GPS/IMU navigation system architecture. 

FIG. 12 is a block diagram of the AGNC’s fully-coupled 
GPS/IMU process. 

FIG. 13 is a functional block diagram of integrated flight 
control and navigation system. 

FIG. 14 is a block diagram of the modular structure of 
integrated flight control and navigation system. 

FIG. 15 is a schematic diagram illustrating the multipath 
introduced by the ISS 2'. 

FIG. 16 is a graph of the multipath signal propagation 
delay. 

FIG. 17 is a graph of non-coherent delay -locked (NCDLL) 
loop s -curve. 

FIG. 18 is a diagram of phase-lock loop with multipath 
mitigation. 

FIG. 19 illustrates the geometrical configuration of the 
LDRI and the AERCom: the LDRI is installed on the ISS 2’ 
which is located in the ISS 2' coordinate frame. 

FIG. 20 is a flow diagram of image processing subsystem. 

FIG. 21 illustrates the image feature extraction algorithm. 

FIG. 22 illustrates an attributed graph representation 
derived form imagery obtained from the inspection process; 
the three detected objects or mage features 1, 2 and 3 are used 
to created or synthesize an attributed graph representation of 
the sensed scene; this sensed graph is then matched with store 
reference graphs. 

FIG. 23 illustrates attributed graph matching process; main 
spacecraft model are used to form reference graphs that are 
input to the matching process (offline); the live imagery 
derived from the stereo sensors is synthesize attributed 
graphs; finally, the two graph representations (reference and 
sensed) are matched using a specialized matching algorithm. 
The output is the largest common subgraph and represents the 
registration of the reference and sensed data. 

FIG. 24 illustrates an auto -associative neural network for 
sensor validation. 
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FIG. 25 illustrates the AERCam 1' jet model. 

FIG. 26 illustrates the AERCam 1' flying a trajectory from 
point A to point B. 

FIG. 27 illustrates the AERCam 1' trajectory in ECEE 
5 coordinate system. 

FIG. 28 is a Table 1 showing the system model of the 
optimal LDRI alignment filter. 

FIG. 29 is a Table 2 showing the definition cf the state 
vector. 

10 FIG. 30 is a Table 3 showing the optimal Kalman filter. 

FIG. 31 is a Table 4 showing the trajectory parameters. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

15 

Generally, IMU/GPS integration can output the position, 
attitude and azimuth of the vehicle itself. A laser ranger mea- 
sures the distance between the object and vehicle. Electro- 
20 optic image sensors derive the 3D environment in the field of 
view. The traditional electro-optic sensor image processing is 
time consuming and unreliable. 

Referring to FIG. 1, the electro-optic sensor image pro- 
cessing comprises a preprocessing module 1, a segmentation 
25 module 2, a detection module 3, a recognition module 4, a 
3D-positioning module 5, a tracking module 6, EO sensors 7, 
anAHRS/INS/GPS Integration module 8, a GPS receiver 9, a 
MEMS I MU 10, and a laser ranger 11. 

Referring to FIG. 2, the preprocessing module 1 comprises 
30 a Median Filter module 1 1, a Histogram Equalization module 
12 and an Inverse Image module 13. 

Referring to FIG. 3, the segmentation module 2 comprises 
a Threshold Black/White module 21, a Suppress Black mod- 
ule 22, a Suppress White module 23, and a Sobel Filter 
35 module 24. 

Edge detection is necessary to detect meaningful disconti- 
nuities in gray level. Line detection and circle detection also 
uses edge detection for segmentation. Hence, a Sobel filter is 
employed for edge detection. The Sobel filter masks are 
40 defined as follows, 

1 [—1 — 2 — 1000121][— 101 — 202 — 101 ] 

Referring to FIG. 4, the detection module 3 comprises a 
Line Detection module 31, a Circle Detection module 32, a 
Comer Detection module 33, a Gabor Filter module 34, and 
45 an Eigenvector Projection module 35. 

Line detection and circle detection are defined in this para- 
graph. The equation of a straight line is x cos .theta. +y 
sin .theta. =.rho.. Ir the .rho.. theta, plane the straight lines are 
sinusoidal curves. Binarized points (i, j) in the .rho.. theta. 
50 plane are used as locations of associated (.rho..sub.i, 
.theta., sub.j) pairs that satisfy the equation of the straight line. 
Similarly, for a circle the equation utilized is (x-c.sub.l). 
sup.2+(y-c.sub.2).sup.2=c.sub.3.sup.2. The Hough transform 
can be generalized to apply to any equation of the form 
55 g(v,c)=0, where v represents the vector of coordinates and c is 
the vector of coefficients. The difference from the 2D param- 
eters case is that the 2D cells and points (i,j) are replaced by 
the higher order cells and points (i,j,k). 

The Gabor filter is used to detect the fiducial features. 
60 Matching the fiducial features in both electro -optic sensors’ 
images results in calculation of the 3D positions of the fidu- 
cial features. The Gabor filter output is constructed as fol- 
lows: 

2C(x,y)=max; I(x,y)j (x,y,)-sj/skl(x,y)k(x,y,)r; 

65 where k=l 1 , j=10, s.sub.j=2.sup.j/2 (scale factor), I(x,y) is 
the original image 

.PHI.. sub.j(x,y,.theta.)=.PHI.(s.sub.jx,s.sub.jy,. theta.) 
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.PHI.(x,y,.theta.)=e.sup.-(x\sup..sup.2.sup.+ 

y , .sup..sup.2.sup.)+i.pi.x* 

x --x cos .theta. +y sin .theta. 
y'=-x sin . theta. +y cos .theta. 

.theta. =0, 90, 180 and 270 degrees (Orientation) 5 

A variety of methods of comer detection can be used to 
detect the comers of the objects. Matching the comers in both 
electro -optic sensors’ images results in calculation of the 3D 
positions of the comers. 

Referring to FIG. 5, the recognition module 4 comprises a 
Matched Filter module 41, a Graph Matching module 42, a 
Comer Classifier module 43, and a Neural Network module 

44. 

Template correlation needs the reference object template 15 
and an image patch selected from the new image frame. 
Denote the two two-dimensional scenes of N.times.M pixels 
by I(k, 1) and J(k, 1) where k and 1 stand for the row index and 
column index, respectively. A direct method would compute 
the cross correlation function between I(k, 1) and J(k, 1) 20 
defined as 3 R(n,m)=l MNk=l Nl=l MI(k, l)J(k+n, 1+m) 
where n and m are the lag length in the row and column 
directions, respectively. However, the evaluation of the cor- 
relation is computationally intensive and normally not used in 
practice. A common way to calculate the cross correlation 25 
other than direct computation is to use the fast Fourier trans- 
formation (FFT). 

In fact, a variety of methods can be used to speed up the 
computation of the correlation function or to reduce the 
amount of memory required. Division of the two-dimensional 30 
array into subarrays where only partial convolutions will be 
computed allows for tradeoffs between speed, memory 
requirements, and total lag length. In addition, since an FFT 
algorithm can accept complex inputs, the processing of two 35 
real series can be made in parallel. Moreover, the application 
of number theoretic results in the FFT transformation can take 
into account quantization of numbers and the finite precision 
of digital machines in the digital transforms. Finally, the use 
of specific hardware such as pipelined processing is now 40 
practical to further increase the real-time computation speed. 

Referring to FIG. 6, the tracking module 5 comprises a 
Peak Tracking module 51, a Centroiding Tracking module 52 
and a Relative Position Tracking module 54. 

Referring to FIG. 7, two electro-optic image sensors are 45 
fixed on the vehicle with their optical axes parallel. The 
baseline b is perpendicular to the optical axes. The vehicle 
body frame can be established as shown in FIG. 7. Let the 
baseline be the x-axis, z-axis parallel to optical axis and origin 
at the center of baseline, and the image coordinates in left and 50 
right images be (x.sub.f, y.sub.l') and (x.sub.r', y.sub.r’), 
respectively. Then 4xl , f=x+b/2 z, xr , f=x-b/2 z and 
yl , f=yr , f=yz 

where f is the focal length. 55 

from the above equations, we get 5x=b(xr+xr , )/2xr-xr f , 
y =b (y f +yr , )/2xf -xr’ , and z=bfid , -xr l . 

According to the optical principle, if pixel resolution 
r.sub.p is known, we have 

x.sub.l -Ptan^. sub.px.sub.pl), y.sub.l-Ptan^.sub- 60 

.py.sub.pl) 

x.sub.r-f*tan(r.sub.px.sub.pr), y.sub.r-Ptan^.sub- 

.py.sub.pr) 

where (x. sub.pl, y.sub.pl) and (x.sub.pr, y.sub.pr) are pixel 
coordinates in the left and right images, respectively. Hence, 65 
the target position with respect to the vehicle frame can be 
calculated. 
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Referring to FIGS. 1-7, the method of three dimensional 
positioning according to the preferred embodiment of the 
present invention is illustrated, which comprises the steps as 
follows: 

(1) Receive images from the EO sensors and send them to 
the preprocessing module 1. 

(2) Perform Median Filtering to suppress noise in the 
Median Filter module 11 and Histogram Equalization to 
enhance the images in the Histogram Equalization module 
12. If the object image library is black, invert the image in the 
Inverse Image module 13. 

(3) Receive preprocessed images from the preprocessing 
module 1 and perform Threshold Black/White in the Thresh- 
old/White module 21, Suppress Black in the Suppress Black 
module 22, Suppress White in the Suppress White module 23, 
and edge detection in the Sobel Filter module 24. 

(4) Receive segmented images from the segmentation 
module 2 and perform Line Detection in the Line Detection 
Module 31, Circle Detection in the Circle Detection module 
32 and Eigenvector Projection in the Eigenvector Projection 
module 35. 

(5) Receive the preprocessed images from the preprocess- 
ing module 1 and perform Comer Detection in the Comer 
Detection module 33, fiducial feature detection in the Gabor 
Filter module 34. Send detected comers and fiducial features 
to the 3D Positioning module 6 and the Recognition module 
4. 

(6) Receive the detected comers from the Corner Detection 
module 33, match the corners in the two images to get the 
disparities, and calculate 3D positions for each comer pair in 
the 3D Positioning module 6. 

(7) Receive the detected fiducial features from the Gabor 
Filter module 34, match the comers in the two images to get 
the disparities, and calculate 3D positions for each comer pair 
in the 3D Positioning module 6. 

(8) Receive detected lines, circles, comers and fiducial 
features from the Detection module 3, get the detected cor- 
ners and fiducial 3D positions from the 3D Positioning mod- 
ule 6, group them in the Graph Matching module 42, Comer 
Classifier module 43 and Neural network module 44, to iden- 
tify certain object. 

(9) Receive the recognized certain object in the Relative 
Position Tracking module 53, wherein the recognized certain 
object includes calculated 3D comers and fiducial features, to 
get the 3D target position. 

Referring to FIGS. 1-7, an alternative method of three 
dimensional positioning according to the preferred embodi- 
ment of the present invention is illustrated, which comprises 
the steps as follows: 

(1 ) Receive the images from the EO sensors and send them 
to the preprocessing module 1. 

(2) Perform Median Filtering to suppress noise in the 
Median Filter module 11 and Histogram Equalization to 
enhance the images in the Histogram Equalization module 
12. If the object image library is black, invert the image in the 
Inverse Image module 13. 

(3) Receive preprocessed images from the preprocessing 
module 1 and perform Threshold Black/White in the Thresh- 
old/White module 21, Suppress Black in the Suppress Black 
module 22, Suppress White in the Suppress White module 23, 
and edge detection in the Sobel Filter module 24. 

(4) Receive segmented images from the segmentation 
module 2 and perform Line Detection in the Line Detection 
Module 31, Circle Detection in the Circle Detection module 
32 and Eigenvector Projection in the Eigenvector Projection 
module 35. 
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(5) Receive preprocessed images from the preprocessing 
module 1 and perform Corner Detection in the Corner Detec- 
tion module 33, fiducial feature detection in the Gabor Filter 
module 34. Send detected corners and fiducial features to the 
3D Positioning module 6 and the Recognition module 4. 

(6) Receive the detected comers from the Corner Detection 
module 433, match the comers in the two images to get the 
disparities, and calculate 3D positions for each comer pair in 
the 3D Positioning module 46. 

(7) Receive the detected fiducial features from the Gabor 
Filter module 34, match the comers in the two images to get 
the disparities, and calculate 3D positions for each comer pair 
in the 3D Positioning module 6. 

(8) Receive GPS measurements, including position, veloc- 
ity and time from the global positioning system 9, and pass 
them to the AHRS/INS/GPS integration module 8. 

(9) Receive inertial measurements including body angular 
rates and specific forces, from the inertial measurement unit 
10, and send them to the AHRS/INS/GPS integration module 
8 which is a signal-processing module. 

(10) Perform inertial navigation system (INS) processing 
in the AHRS/INS/GPS integration module 8. 

(11) Receive the laser ranger measurement from a laser 
ranger 11' and send it to the recognition module 4. 

(12) Receive the preprocessed images from the preprocess- 
ing module 1, match the processed target template and output 
to the Peak Tracking module 51 or Centroiding Tracking 
module in the Tracking module 52. 

(13) Receive detected lines, circles, corners and fiducial 
features from the Detection module 3, get the detected corner 
and fiducial 3D positions from the 3D Positioning module 6, 
group them in the Graph Matching module 42, Comer Clas- 
sifier module 43 and Neural network module 44, to identify 
the certain object. 

(14) Relative Position Tracking module 53 receives the 
recognized certain object, which comprises calculated 3D 
corners and fiducial features, to get the 3D target position. 

According to the preferred embodiment of the present 
invention, Step (12) further comprises of the following steps 
(as shown in FIG. 1): 

(12-1) Retrieve the target knowledge database to get the 
target template, receive the attitude and azimuth from the 
AHRS/INS/GPS Integration module 8, and rotate the target 
template in the Matched Filter module 41. 

(12-2) Receive the laser range from the Laser Ranger mod- 
ule 11, and shrink or enlarge the processed images from step 

(1) in the Matched Filter module 41. 

(12-3) Do the Match Filter in the Matched Filtering module 
41. 

The present invention employs electro-optic image sensors 
integrated global positioning system/inertial measurement 
unit and laser ranger, to provide reliable and real time object 
3D position. These data can be used by an autonomous 
vehicle or a robot controller. The advantages of the present 
invention include: 

(1) The electro-optic image sensors’ measures the feature 
and comer 3D positions. The 3D positions can be grouped 
with detected lines and circles for the recognition of certain 
objects, such as fork holes, pallets, etc. 

(2) The IMU/GPS integration system provides the vehi- 
cle’s attitude and azimuth so as to rotate the target library in 
the sensor/target knowledge database in order to match the 
electro-optic sensors’ images. This dramatically reduces the 
storage volume and matching time. It is not necessary to store 
different kinds of objects in orientation in the sensor/target 
knowledge database and match the object at different orien- 
tations. 
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(3) The laser ranger measures the distance between the 
object and vehicle. This reliable distance can be used to 
calibrate the 3D electro-optic sensors’ position. It can also be 
used to shrink and enlarge the target library in the sensor/ 
5 target knowledge database in order to match the electro -optic 
sensors’ images. This dramatically reduces the storage vol- 
ume and matching time. 

In another preferred embodiment, this invention developed 
a miniaturized GPS/MEMS IMU integrated navigation sys- 
10 tern. The following are the requirements and problem identi- 
fication of this embodiment. 

NASA AERCam l”s responsibilities include: 

Allow orbiter intravehiclar activity (IVA) crews to observe 
Extravehiclar Activities (EVAs) 

15 Inspect a location without an EVA 

View a location not visible to an EVA crew member or 
remote manipulator system camera 

Can be used to directly support an EVA by giving IVA crew 
members the ability to freely move their eyepoint 
20 The missions assure a precise navigation solution to the 
AERCam 1*. Autonomous AERCam 1' navigation requires 
precise determination of the relative position and attitude in 
relation to the ISS 2'. The relative position and attitude infor- 
mation is relayed to the control station so that the crew can 
25 control the AERCam 1' in real-time. The navigation system 
has the capability to provide its location relative to the ISS 2' 
to perform automated maneuvers in case of the loss of com- 
munications, or other contigency situations. In other words, 
the autonomous AERCam 1* navigation system provides self- 
30 contained relative navigation with crew-in-the-loop, as well 
as fully autonomous operation without instructions from the 
control station. 

This invention develops an intelligent automated system 
that utilizes multiple sensors (GPS 9, IMU 10 and Cameras 
35 71) to realize autonomous navigation for the AERCam 1' 1' 
with capabilities to perform highly precise relative attitude 
and position determination, intelligent robust failure detec- 
tion and isolation, advanced collision avoidance, and on- 
board situational awareness for contingency operations. The 
40 autonomous AERCam 1' navigation system provides self- 
contained relative navigation with crew-in-the-loop, as well 
as fully autonomous operation without instructions from the 
control station. The proposed multi-sensor system design 
with redundancy for the AERCam 1' is shown in FIG. 8. 

45 A space-borne GPS interferometric receiver with multiple 
antennas can provide absolute measurements such as the 
Earth orbiter’ s position, velocity, as well as attitude. In the 
relative navigation system, two GPS receivers are installed, 
one on the AERCam 1' and one on the ISS 2' 2', to provide 
50 precise relative position at the centimeter level and relative 
attitude information. Because of the integration with the INS, 
the critical requirement on the GPS receiver for receiving at 
least 4 GPS satellites is waived. This allows the proposed 
navigation system to work in close proximity operations. 
55 When the relative GPS attitude is unavailable due to the 
misalignment between the AERCam 1* vehicle and the ISS 2' 
2', and/or signal blockage, the integrated system continues 
relative attitude determination in the IMU/camera mode. Due 
to the drift of the IMU sensors, the INS position errors 
60 increase with time. This IMU shortcoming is compensated by 
the GPS or camera when GPS navigation data or images are 
available. 

When the AERCam V is far away from the ISS 2' 2’, the 
relative GPS provides the navigation data. In addition, the 
65 GPS data is used to compensate the INS errors and drift. For 
this case, the AERCam 1* navigation system works under the 
GPS/INS integration mode. When the AERCam 1’ is close to 
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the ISS 2' 2', the GPS signals may be lost due to blockage or 
multipath noise. We use the baseline signal-to -noise ratio 
(SNR) to detect the existence of multipath. A robust Kalman 
filter multipath mitigation algorithm is applied to eliminate 
the multipath effect based on the SNR measurement and 
computed SNR profile. 

The system operation scenarios include: 

Fully-Coupled GPS/IMU integration mode under the con- 
dition of favorable geometry among the GPS satellites, 
the AERCam 1' and the ISS 2' 2', when the AERCam 1' 
is far away from the ISS 2' 2’ (remote operation). Under 
this operation mode, the IMU-derived velocity informa- 
tion is used to aid the carrier phase and code tracking 
loops of the GPS receiver to improve the dynamic per- 
formance as well as the signal -to-noise (SNR) ratio. The 
GPS data is used to compensate the IMU sensor errors 
and computational errors. 

IMU/Camera integration mode under the condition of: 
GPS signal blockage; 
large multipath noise; 

Unfavorable geometry among the GPS satellites, the 
AERCam 1’ and the ISS 2 T 2'. 

The INS navigation errors grow with time and need to be 
estimated and reset frequently during the mission. For 
the proximity operation, the range and range rate 
between the AERCam 1' and the ISS 2' 2' are blended to 
compensate the IMU sensor drift during GPS outages or 
unreliable GPS data. 

Periodically the Laser Dynamic Range Imager (LDRI) is 
used to align the AERCam 1' navigation system. The 
LDRI is installed on the ISS 2' 2' and can take a 3-di- 
mensional image of the AERCam 1' to derive range, 
range rate and attitude information of the AERCam 1' 
once the AERCam 1' is in the field of view (FOV) of the 
LDRI. The LDRI alignment technique is a feasible solu- 
tion for reducing the errors of the AERCam 1' navigation 
system when GPS is not available. 

Aligning the INS with GPS data. GPS data compensates 
the IMU errors when GPS becomes available. 

Interferometric GPS processing for attitude determination. 
The following disclose the Optimal Multi-Sensor Navigation 
System Design with Redundancy 
Top Level Design 

An optimal multi -sensor navigation architecture, as shown 
in FIG. 9, takes full advantage of heterogeneous sensors to 
provide seamless autonomous navigation for the AERCam 1'. 
The involved navigation sensors are relative GPS, Inertial 
Measurement Unit (IMU), and cameras installed on AER- 
Cam T. All raw measurements from all individual sensors are 
injected into a data fusion system to derive precisely relative 
position and attitude information. 

Relative GPS requires that the AERCam 1' and the ISS 2' 
track at least four common GPS satellites simultaneously. 
The relative GPS system works well when the ISS 2' and the 
AERCam 1' are widely separated due to good geometry 
formed between the AERCam 1', the ISS 2', and the GPS 
satellites. Relative GPS-alone may intermittently fail when 
the AERCam 1' maneuvers into the proximity of the ISS 2' 
because of occasional strong multipath signal and GPS signal 
blockage. This GPS weakness is compensated by optimally 
blending it with the IMU data, such as gyro and accelerometer 
measurements. 

Three accelerometers and three gyros are used in this 
multi-sensor based navigation system to provide three-di- 
mensional position and attitude solutions. IMU sensors are 
self-contained motion-sensitive devices. The gyros measure 
the angular rate and the accelerometers measure the linear 
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motions of the platform. When the GPS solution is available, 
the Inertial navigation system (INS) is initialized using the 
GPS solution. In close proximity, the INS tracks the position 
and attitude of the AERCam 1* relative to the ISS 2’. 

5 The INS navigation errors grow with time and need to be 
estimated and reset frequently during the mission. For the 
close proximity operation, the available GPS signals and the 
cameras are used to aid the INS to maintain highly accurate 
relative navigation. The range and range rate between the 
10 AERCam 1' and the ISS 2' are blended in the multi-sensor 
fusion algorithm to compensate for the EMU sensor drifts 
during GPS outage or unreliable GPS data. 

The two cameras installed on the AERCam 1' are used to 
15 image the ISS 2', as shown in FIG. 10. These images are 
further processed via correlation and coordinate transforma- 
tions techniques to derive the range and the range rate 
between the AERCam 1' and the ISS 2'. It may not be possible 
to derive the range and range rate on-board of the AERCam 1' 
20 because of the computational requirements. In such case, the 
image parameters may be transmitted to the control station 
which performs the computation, and possibly transmits the 
range and range rate back to the AERCam 1'. 

A novel sensor validation approach by using neural net- 
25 works is used to perform intelligent failure detection and 
isolation (IFDI) for multiple disparate navigation sensors. 
Failure detection and isolation technology plays an important 
role in the fully autonomous navigation system. An auto- 
associative neural network, which has four hidden layers for 
30 information compression and data regeneration, is trained to 
generate filtered sensor estimates for all sensors even though 
some of the sensor measurements have been corrupted by 
noise, disturbances or failures. This lessens the impact of a 
failed sensor on the network output. The failure isolation by 
35 the neural network is achieved by blocking out the weights 
directly connected to the failed sensor in the network input. 
Miniature MEMS IMU 

AGNC’s MEMS coremicro IMU can support the AERCam 
1* navigation system with features of low power consumption, 
40 lightweight, and small size. 

Formulation of Relative Navigation Using GPS Carrier Phase 

The objective of relative navigation is to determine con- 
tinuously the coordinates of an unknown point with respect to 
a known point, such as the ISS 2'. In other words, relative 
45 navigation of AERCam 1' aims at the determination of the 
vector between the AERCam 1' and the ISS 2'. Introducing the 

corresponding position vector it aercg m an d lt ISS , the rela- 
tion can be formulated as: 

50 

^ISS = ^AERCam + & ( 0 . 1 ) 

where Ff is the vector pointing from the AERCam 1* to the ISS 

2\ The components of the vector b are 

55 



X/ss ~ X AERCam 


AX 

b = 

YlSS ~ Y AERCam 

= 

AY 


. Ziss ~ Z AERCam . 


_ AZ _ 


GPS relative navigation for the AERCam 1’ is effective if 
simultaneous observations are made at both the AERCam 1* 
and the ISS 2*. Simultaneity means that the observation time 
65 tags for the AERCam 1* and the ISS 2' are the same. Assuming 
such simultaneous observations at the AERCam 1* and the 
ISS 2' to two satellites i and j, linear combinations can be 
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formed leading to single-differences and double-differences 


between observables of the GPS signal from multiple anten- 
nas and multiple satellites. 

™°\k) = lp$(*) - fS l2 (k) - N$ + e ( £(k) 

(0.7) 

GPS Carrier Phase Model 

where, 


Highly accurate positioning with GPS can be obtained by 5 

V<S>°\k) = ^ s (k)-<S> ( { , ERC<lm (k) 

(0.8) 

using of carrier phase observables. A general GPS carrier 
phase model is given by: 

P 12 W =P/SsW-PaESCotiW 

(0.9) 

, 1 . . d e ph diono d trop (0.3) 

*- x p+fS - N + ir~ — + ^r +£ 

6 n {k) = 6 iss(k) - S AERC am(k ) 

(0.10) 

\iU) _ jv/0) \jU) 

N il ~ N ISS ~ N AERCam 

(0.11) 


£ n (*) = £ \ss(k) - £ AERCam (k) 

(0.12) 


where 

<D=the GPS carrier phase measurement (in wavelength); 15 
Z=the signal wavelength; 

p=the true geometric distance between the GPS receiver 
and satellite; 

f=the signal frequency; 20 

6=6‘ s -6 iJ the clock error, is the satellite clock bias, b R is 

the receiver clock error; 

N=the carrier phase integer ambiguity; 
d ei ^=the range error induced by ephemeris error; 25 

d. owo =the propagation error induced by the ionosphere; 
d trop =X\\Q propagation error induced by the troposphere; 

€=the phase noise. 

For the ISS 2' and the AERCam 1', the carrier phase model 30 
is slightly different from the above equation, because there is 
essentially no air above 400 kilometers from the Earth’s 
surface. Without the atmospheric effects impacting on the 
GPS carrier phase, the carrier phase measurement model for 
the ISS 2' and the AERCam 1' is: 35 


1 d; nrtn 

— X f 


(0.4) 


40 


Single-Difference Carrier Phase Model 

There is an assumption that both of the ISS 2' and the 
AERCam 1' have a carrier phase GPS receiver. Based on the 
carrier phase measurement model given in equation (2), we 45 
obtain the ISS 2' and AERCam 1' carrier phase measure- 
ments: 


tfrssft) - 

+ fW « - «««) - ^ 

^AERCam (H) = J^P. 'AERCam (U + ~ $ AERCam (kj) - 


N AERCam + 


A 


A 


+ S' AERCam (*) 


(0.5) 


( 0 . 6 ) 
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The benefit of forming single differential carrier phase 
measurement is the cancellation of the satellite related com- 
mon errors, such as the satellite clock error and the ephemeris 
error, etc. 

Double-Difference Carrier Phase Model 

Assuming two satellites i and j are observed, two single- 
difference carrier phase measurements according to equation 
(2.7) can be formed. These single-difference carrier phase 
measurements are subtracted to obtain the double-difference 
carrier phase measurement: 


= ipf (*) - n‘{ 2 + 4(*) 

where, 


®\ss(k) - 

^AERCam(k) _ 

Pi 2 (k) = p\ J ss(k) - P'AERCam (k) ~ p\‘ss(k) + P^AERCam(k) 


AV<D M\k) -- 


®/ss(k) - 
^AERCam (U 


\j(j) Aj(j) 

V ISS /v AERCam 


v AERCam 


£ 12 (k) - s\ss(k) ~ ^AERCam(k) ~ £ \‘ss(.k) + £ ( AERCam(k) 


(0.13) 

(0.14) 

(0.15) 

(0.16) 

(0.17) 


This time, in addition to removing the satellite clock errors, 
the GPS receiver-related common errors for the ISS 2' and the 
AERCam 1' are eliminated by the double-difference carrier 
phase measurements. 

Relative Navigation Using Single-Difference Carrier Phase 
When the model of single differential carrier phase is con- 
sidered, the terms comprising unknowns in nonlinear form 
are p/ss^OO and p AERCam^O^)- Because the AERCam 1* 
moves in the proximity area around the ISS 2', we can use an 

initial position X 0 =(X 0 , Y 0 , Z 0 ) for both the AERCam 1' and 
the ISS 2' to linearize the terms of and p AERCam^ 00 . 

Having this initial position, the unknowns of the AERCam 1* 
position and the ISS 2' position can be decomposed as 

X AERCam = X^tSX AERCam 
Y AERCam = T)+A Y AERCam 


where, k is the carrier phase measuring epoch; superscript (j) 
means that the corresponding items are related with the GPS 
satellite j ; subscript ISS 2' means that the corresponding items 
are related to the ISS 2' GPS receiver; subscript AERCam 1* 
means that the corresponding items are related to the AER- 
Cam 1' GPS receiver. 

By subtracting (2.6) from (2.5), the single differential car- 
rier phase measurement is obtained as follows: 


Y'AERCam Zo +^Z AERCam (0.18) 

Y IS s=Y 0 +AY ISS 

Ziss = Zo+kZ ISS (0-19) 

where now {&&AERCam> AY AERCam , AZ AE RCam ) anc ^ (AX /iSS , 
AY iss, AZ /tStS ) are the new unknowns. By expanding 


60 


65 
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P AERCanf^Qz) an d P/ss^OO as a Taylor series with respect to 
the approximate point, we obtain 


JJ) 

PAERCar, 


* ll* 0 ’ - Xj| - ^- AX AE RC.m - 


( 0 . 20 ) 5 


Y {i) - Yo 


ZfJ>-Z o 

AERCam ~ “ — fR -A Z A ERCam 




Ms * II? 01 - Xo\\ - - 

\\x - 


( 0 . 21 ) 
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-Xoll 

Y (J) - Yo 


Z°' } - Z 0 

A Yfss- TT^J) — 77 AZ/SS 


wr^-xoW ir-xoii 
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Therefore, the GPS relative navigation equation using single 
differential carrier phase is given by 


[V<D W 4 - V^]A = 


20 

( 0 . 22 ) 


X (j) - X 0 Av Y (j) -Y 0 


Zf^-Zc 

llx O) -X 0 || 


AZ- /<5 12 


25 


After fixing the carrier phase integer ambiguity, there are four 
unknowns in the above equation. They are the three dimen- 
sional coordinates of the ISS 2' relative position with respect 
to the AERCam 1' and the receiver clock bias f& 12 . Conse- 30 
quently, four satellites are needed to solve this problem. 
Relative Navigation Using Double-Difference Carrier Phase 
Similarly, after establishing the double-difference carrier 
phase integer ambiguity, the GPS relative navigation equation 
using double-difference carrier phase measurements is given 35 
by 


[AVfcW + /Vf 2 ]A 


X (i) -X 0 

x^-x 0 


ll^-Xoll 

Y V) - Yo 

Y^-Yo 

IlIxUxJ 


Z«>-Zo 

Z^-Zo 

Illx i, -X 0 || 



(0.23) 
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Using double-difference carrier phase relative positioning, 
three GPS satellites are needed to solve for the three ISS 
2 , -to-AERCam V relative position components AX, AY and 50 
AZ. 

Miniature MEMS IMU 

The potential impact on the MEMS IMU accuracy can be 
mitigated via smart integration algorithms with other naviga- 
tion sensors. 55 

Sources of rate sensors and accelerometers have been 
sought out. Characteristics of the sensors were obtained so 
that models of the MEMS based IMU can be generated for 
simulations of the AERCam 1' navigation system. This 
include sensor biases, drift rates, response times and noise 60 
sources. 

MEMS IMU Error Model 
Gyro Errors 

The gyro errors can be generally described by the total gyro 
drift rate. A typical MEMS gyro drift rate is 65 


drift va.te(e)=e B +e R +AK g ()i in +e d +(r i ,+ej{T)+e nofl + . . . (0.1) 


where 

e^=Bias and random drift, caused by torquer coils, con- 
stant disturbing torque, friction and other reasons, dif- 
fers slightly each time the instrument is turned on and 
will fluctuate randomly with time. The drift can be deter- 
mined through testing at the laboratory or compensated 
with a random constant in the integrated Kalman filter, 
or gyros themselves are slowly rotated in order to aver- 
age-out their bias drift. 

€ i? =Gyro time-dependent random drift. The drift is esti- 
mated as a stochastic process in the integrated Kalman 
filter. 

AK^oc). w =Gyro scale factor error, is proportional to the input 
angular rate and becomes quite remarkable in a high 
dynamic environment. AK^ is generally unknown and 
must be estimated during dynamic calibration. 

e rf =The error caused by the angular motion of the flight 
vehicle, is a systematic error and can be compensated by 
analytical methods in the design. 

e g =The error caused by the linear motion of the flight 
vehicle, including mass -unbalance drift, anisoelastic 
drift and others. The error is proportional to vehicle 
acceleration and can be compensated by analytical or 
experimental methods. 

€ j(T)=Temperature-dependent gyro drift. This tempera- 
ture coefficient of drift determines the necessity for the 
thermal control of the gyro. 

e wow =Gyr° nonlinear error, could be rather large while the 
gyro experiences a large input angular rate. The nonlin- 
ear error is a systematic error and can be compensated by 
analytical methods. 

Accelerometer Errors 

Several factors make an accelerometer deviate from its 
ideal value, such as, the angular motion and the acceleration 
motion, random bias, scale factor, dead zone, cross-axis sen- 
sitivity, temperature and others. A typical MEMS accelerom- 
eter error model is expressed as: 


bias (V)=V B +V R +AKJ' in +V j{T)+¥ non + . . . (0.2) 

where 

Vg=Bias and random constant error, caused by dead zone, 
disturbing forces, hysteresis, etc. This bias is slightly 
different each time the instrument is turned on and will 
slowly vary randomly with time. The uncompensated 
residual causes navigation errors. 

V^=Time-dependent random bias. The random bias is a 
critical error to accelerometer performance. Therefore, 
the bias must be estimated and corrected with a stochas- 
tic process in the integrated Kalman filter. 

AK a f IW =Scale factor error of accelerometer. This error is 
proportional to the input specific force, and it can be 
quite remarkable in a high dynamic environment. AK a is 
generally unknown and must be determined during 
dynamic calibration. 

V rf =The error caused by the translational motion of the 
flight vehicle, is a systematic error and can be compen- 
sated by analytical methods in the design. 

V^=The error caused by the linear motion of the flight 
vehicle, including mass-unbalance drift, anisoelastic 
drift and others. The error is proportional to vehicle 
acceleration and can be compensated by analytical or 
experimental methods. 
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Vj(T)=Temperature-dependent accelerometer drift. This 
temperature coefficient of drift determines the necessity 
for the thermal control of the accelerometer. 

V wow =Accelerometer nonlinear error. The nonlinear error 
is a systematic error and can be compensated by analyti- 
cal methods. 

The MEMS IMU error models were embedded in the hard- 
ware-in-the-loop simulation and test system. 

Miniature GPS/MEMS IMU Integrated Filtering 
Integration Architecture Design 

The IMU navigation solution drifts with time. A GPS solu- 
tion can effectively correct the IMU navigation solution. On 
the other hand, a stand-alone GPS receiver suffers from inter- 
mittent loss of the GPS signal due to high-dynamic vehicle 
maneuvering, interference, jamming or multipath signals. It 
is very important to strengthen GPS signal tracking to reduce 
the possibility of the loss of a GPS signal. It is well known that 
there exists the usual loop bandwidth versus dynamic perfor- 
mance tradeoff commonly encountered in GPS signal track- 
ing loop design: the effects of noise increase with increasing 
loop bandwidth, while dynamic tracking errors increase with 
decreasing loop bandwidth. To resolve the conflict between 
the GPS signal tracking loop dynamics versus noise perfor- 
mace, it is recommended that the acquisition and tracking 
processes of the GPS signals should be aided by the INS to 
extend its dynamics while maintaining the minimum tracking 
loop bandwidth. An appropriate architecture for a fully- 
coupled GPS/MEMS IMU integrated system is one that pro- 
vides the mechanics of using the GPS solution to aid the 
inertial navigation system (INS) and using the INS solution to 
aid the code and carrier tracking of a GPS receiver. The 
fully-coupled GPS/INS integration architecture is given in 
FIG. 11. 

The above fully coupled GPS/IMU navigation system 
architecture has the following important features: 

Hardware-level redundancy: In the integration mode, the 
GPS receiving set is used as one of the sensors (GPS, 
gyro and accelerometer) of the integrated navigation 
system. The restriction of at least 4 satellites for naviga- 
tion solution computation can be significantly relaxed. 
The hardware-level redundancy will help to enhance the 
reliability of the overall system through fault-tolerant 
software design. 

Low-cost IMU sensors: In the fully coupled GPS/IMU 
system, precise positioning results can be used to rou- 
tinely correct IMU instrument errors inflight. Therefore, 
low-cost non-INS-grade inertial sensors can be utilized 
in the integrated navigation system. 

Minimum tracking loop bandwidth and high anti-interfer- 
ence: In the integration mode, the V-A solution of the 
integration filter is transferred as V-A information along 
the line-of- sight between the GPS satellites and the inte- 
grated system, and fed back at a high rate to the GPS 
digital signal processor. In the signal processor, the V-A 
information is used to compensate for the spacecraft 
high dynamics. Therefore, the fixed bandwidth of the 
tracking loop can be reduced to a minimum to prevent 
unwanted interference noise. 

Fast Phase Ambiguity resolution/cycle slip detection on- 
the-fly: The precise positioning results of the integrated 
system can generate the computed range between satel- 
lites and the navigation system. The computed range is 
compared with the measured range between the satel- 
lites and the navigation system, and the resultant differ- 
ence can be utilized to detect cycle slip and reduce the 
ambiguity search space efficiently. 
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High navigation accuracy: The fully coupled GPS/IMU 
system uses the kinematic GPS technique with centime- 
ter-level measurement accuracy to significantly improve 
the navigation accuracy. Once atmospheric delays and 
5 selective availability (using dual-frequency and an 

authorized GPS receiving set), phase ambiguity and 
cycle slip problems are solved, the navigation accuracy 
of the integrated system only depends on the IMU instru- 
ment errors. The system is designed to perform IMU 
1 dynamic corrections and alignment. Furthermore, the 

integrated navigation output is at the rate of the INS 
output. 

The GPS receiving set in the system must provide raw 
1 - pseudorange and carrier phase observables for the integrated 
navigation Kalman filter and a synchronous timing signal for 
the data sampling electronics of the IMU. Asynchronous 
velocity -acceleration (V-A) aiding information may cause the 
tracking loops to lose lock. Therefore, the GPS receiving set 
20 must be designed to have a high-speed interface at a rate of 
100 Hz or more for the tracking loops, and a slow-speed 
interface at a rate of 1-10 Hz for the integrated navigation 
Kalman filter. The IMU sensors electronics must provide 
Av-A0 (acceleration and angular rate) information for the 
25 integrated navigation Kalman filter. The Av- A0 information i s 
synchronized with the GPS measurements through a synchro- 
nous timing signal. The IMU instrument errors are corrected 
in the integrated navigation Kalman filter. Therefore, there is 
only one high-speed interface between the navigation Kal- 
30 man filter and the IMU electronics. This method reduces the 
complexity of the hardware design between the integrated 
navigation Kalman filter and the IMU electronics. However, 
the software complexity of the integrated system originates 
35 from the design of the integrated navigation Kalman filter. 
The current high-speed (more than 50 MHz) and modem 
mathcoprocessors allow this complexity to be overcome. 
GPS and IMU Data Fusion 

The navigation equation is given in the Earth-Centered 
40 Inertial (ECI) System. The orientation of the inertial coordi- 
nate axes is arbitrary. For inertial navigation purposes, the 
most convenient orientation coincides with the x, y, z conven- 
tional terrestrial reference system at the start of navigation. 
Let the symbols xe, ye, and ze denote the three ECI axes. At 
45 any time, after navigation begins, the ECI coordinates remain 
in a fixed orientation in inertial space while the origin moves 
with the Earth. The ze axis continues to be coincident with the 
Conventional Terrestrial Pole (CTP), but the xe axis is no 
longer parallel to the zero meridian plane because of the 
50 rotation of the Earth. 

Theoretically, axes that are fixed to the Earth are not inertial 
axes, because of the various modes of motion that the Earth 
exhibits relative to the fixed space. The most important of 
55 these noninertial influences are (1) daily rotation of the Earth 
about its polar axis; (2) monthly rotation of the Earth- Moon 
system about its common mass or bary center; (3) precession 
of the Earth’ s polar axis about a line fixed in space; (4) motion 
of the sun with respect to the galaxy; and (5) irregularities in 
60 the polar precession (or nutation). Even in the presence of 
these noninertial influences, the ECI is an important naviga- 
tion coordinate system in that Newton’s laws are approxi- 
mately correct, and it is sufficient for vehicles navigating in 
the vicinity of the Earth. 

65 FIG. 12 gives the innovative approach applied in this inven- 

tion for lull integration of GPS raw data and the MEMS IMU 
raw data. 
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The GPS measurement equations in ECI are given by: 


&c,a = Sc(T, o) - K(T 0 ) - T t b K aim (O-D 

1 1 5 

y = - [i 4 cm I - - 5 cm ■ ■ 

where 

R=ECI position vector of the center of mass for the AER- io 
Cam 1 *; 

R 4/A ^=body -fixed coordinates of the AERCam 1 ' antenna 
with respect to the mass center; 

Tg=trans formation matrix from ECI to body-fixed coordi- 
nates; 15 

R 4 =R+ T^ r R^ /A ^=the ECI position vector of the AERCam 
1' antenna; 

R g =ECI position vector of the GPS satellite; 

Ap zowo =i° n0 spheric refraction correction in meters; 

Ap e ^=GPS ephemeri s error along the line of sight from the 20 
AERCam 1 *; 

Modeling of GPS Receiver 

The primary tasks accomplished by a GPS receiver in the 
fully-coupled GPS/IMU integration unit are as follows: 

Identification of all visible satellites with calculation of 25 
geometric dilution of precision (GDOP); 

Measurement of satellite- to -receiver pseudoranges and 
decoding of the navigation message; 

Delivery of this data to the navigation microprocessor; 

Receiving of velocity and acceleration aiding data from the 30 
integration Kalman filter to perform external aiding, 
carrier phase, and code tracking. 

In the fully-coupled integration Kalman filter where the 
pseudoranges are used as observables, the receiver clock drift 
and uncertainties are used as two elements of the system state 35 
vector. The receiver clock drift b t is represented by the inte- 
gration of an exponentially correlated random process x t : 

x t =-ax t +w t 


with a=l /500 and w r being Gaussian white noise with a w = 
10 -12 , to model a typical frequency drift rate of 10“ 9 s/s for a 
quartz TCXO. 

The atmospheric delays are caused mainly by the propa- 45 
gation of the electromagnetic wave through the ionospheric 
and tropospheric layers. The atmospheric delays are repre- 
sented by 


50 

A trop (0) = 10- 6 {<r(V (* + hd) 2 ~ R 2 cos 2 9 - flsinfl) + 

<T(V ( R + h ") 2 - * 2c °s 2 0 - Ksinfl)} 

55 

where R is the Earth’s radius, h d and h w are the heights of the 
dry and wet tropospheric layers. The reflection indices are 


<T = 11. (A P - and 

ACT = -12.96- +3.718 xl0 5 ^r. 

W,\J rp rp2 


Modeling of the INS 

A complete picture of INS errors would involve a large 
number of states. Due to restrictions of the on-board compu- 
tational resources, reduced order models have to be applied in 
practical designs. A simplified model capturing all critical 
features of an INS is described by the following differential 
equations: 


Sr N = -XsinL5r E + L6r D + dv N (0-4) 

dr E = Asi oLdr^ + XcosLdro + 6v E 


6rj) = -LSr N - XcosL6r E - + 6 vd 

s . fD + 8, /£ta nL 

Sv N = — <5r/v + — - — Sr E - 

A A 


(211 + A)sinL(5v £ + LSv D - /d^e + /e®d + A/v 


,. fo + g + //vtanL , . 

6 v E = Sr E + (2f2 + AjsinLtSv/v + 


(2fl + A)cosZx5v £ + f D <b N - f N $ D + A E 


6 v d = y 6kn + Y 6rE + ("J" ” c z\ 6r D - ~ 


(2f2 + A)cosZx5v£ - /e$>n + fE®E + 


ft si nL ( vd LtanL | AcosL 

(bfj = 6r\i + — r- H \6r E -\ 6rn + 

™ N [R 2 R ) E R 


- 6v e - (ft + A)sinL0 £ + h() D + s N 


vd AsinL L 1 
4 >e = ~~gi 6r H + ~^~ 6rE ~ r 6vd ~ R 6rN + 


/ftcosL A tan/w . vn\ 

■ + RSSL* r " + -r{ I » aL+ T) s *- 


* 


(ft + A]sinL0^ + (ft + X^jcoshpD + £ e 
tanL/_ , v D \ 


AsinL tanL . , . 

R 6ro — <5v £ - IxpN - (ft + XjcoshpE + £d 


where the subscripts N, E, D stand for the North-East-Down 
local level reference frame, Sr^, &r E , br D denote the INS 
position errors, Sv^, 5 v £ , 6 v^ the INS velocity errors, <D V , 
the INS attitude errors and azimuth error; X and L are the 
longitude and latitude angles; R is the radius of the earth and 
Q is the earth’s angular rate; f is the specific force measured 
by the accelerometers; and c 4 and c 2 are damping gain param- 
eters introduced by the altimeter damping loop of the vertical 
channel. The input axes of the gyros and accelerometers are 
assumed to be aligned with the principal axes of the vehicle. 
A^, A e , A d and € E , € n are the errors of the accelerometers 
and gyros mapped from the vehicle body frame into the 
navigation frame, respectively, using appropriate elements of 
the direction cosine matrix. 

The gyro and accelerometer error models are given by: 
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A Gaussian white noise with a standard deviation equal to 5 % 65 
of A tropo (Q) is added to the pseudoranges to take uncertainties 
of the model into account. 
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where S z =scale factor errors; M^misalignment errors; 
G z;; .=g-sensitive drifts; G z 2 =g 2 -sensitive drifts; € z =gyro bias 
drifts; n z =random walk errors. 


f 6a x > 


kx Try Txz 


'A * ' 

6a y 
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Lyx Ky Ly Z 

a b + 

A, 

V $ a z J 


TzX L Z y K z 
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where K z =scale factor errors; L z ^=misalignment erros; 
A z =accelerometer bias. 

The navigation filter also includes descriptions of the 
dominant inertial instrument errors, i.e. gyro drift and accel- 
erometer bias. Their estimates are used for sensor error com- 
pensation. 

Integrated GNC 

FIG. 13 shows the functional block diagram of the inte- 
grated GNC for autonomous spacecraft. The system consists 
of three main subsystems: 

Navigation subsystem. This subsystem provides accurate 
navigation solutions and attitude measurements for the 
flight management and flight control subsystems. 

Flight management subsystem. This subsystem generates 
flight commands, such as attitude control commands 
and trajectory -tracking control commands, in terms of a 
desired flight trajectory, aerodata, attitude measure- 
ments, and navigation solutions. 

Flight control subsystem. This subsystem performs high 
performance flight control. 

The navigation subsystem utilizes AGNC’s existing fully 
coupled GPS/IMU technology. The successful operational 
implementation of GPS provides state-of-the-art navigation 
capabilities through provision of extremely accurate three- 
dimensional position and time information. An integrated 
GPS/INS system provides even further benefits by exploiting 
the best attributes of both systems in a synergistic manner. 
Such an integrated navigation system will provide better reli- 
ability, smaller navigation errors, and improved survivability. 
Specifically, the INS can help GPS by providing accurate 
initial estimates on position and velocity, thus reducing the 
time required for the GPS receiver to lock onto the signals 
streaming down from the satellites. If one or more of the 
satellite signals is subsequently lost due to receiver malfunc- 
tion, terrestrial blockages, wing shielding, or low signal/noise 
ratio, the inertial navigation system can help achieve reacqui- 
sition quickly and efficiently. The continuous velocity mea- 
surements obtained from the inertial system allow the GPS 
receiver to estimate the magnitude of the current Doppler 
shift so that it can narrow the bandwidth of its tracking loops. 
This improves the dynamic operation of the integrated navi- 
gation system and also increases its jamming immunity. On 
the other hand, the GPS receiver can help the inertial naviga- 
tion system with accurate, real-time estimates on the current 
behavior of its error statistics. This helps to provide a more 
stable and accurate navigation solution. Absolute geoloca- 
tion, attitude, and precise relative navigation are critical capa- 
bilities for autonomous vehicles. Integrated GPS/INS navi- 
gation systems will provide the most promising navigation 
device for such systems. 

Flight navigation and control is a multiple objective opti- 
mization problem. The control is required to achieve a high 
level of precision, robustness, and reliability to improve mis- 
sion effectiveness and completion probability. Furthermore, 
time varying and nonlinear dynamics may be at issue. 
Advanced techniques have made significant progress in the 


20 

areas of robust control, nonlinear control, and intelligent con- 
trol. These techniques provide an opportunity for the design 
of high-performance spacecraft flight control systems. Spe- 
cifically, a control integration scheme of nonlinear control, 
5 robust control, fuzzy logic control, and neural network con- 
trol will be investigated and developed to address specific 
issues, such as nonlinearities, uncertainties, and component 
failures, arising during the flight control of spacecraft. The 
objective is to improve performance robustness and reliabil- 
10 ity for all flight conditions. The nonlinear control loop is 
employed to approximately linearize and decouple the input- 
output dynamics of the system, to compensate for nonlinear 
effects, and to achieve the design requirements for nominal 
15 operation. The robust control loop design is based upon the 
linearized and decoupled system dynamics to guarantee per- 
formance in the presence of uncertainties and to provide 
robust stability. Finally, the intelligent adaptive control loop 
is employed to provide adaptivity and intelligence and to 
20 fine-tune control performance. This optimal combination 
scheme exploits and integrates the merits of nonlinear, robust, 
intelligent, and adaptive control and is expected to greatly 
enhance spacecraft performance. 

In summary, the integrated GNC system has the following 
25 features: 

High-speed data processing. The high-speed data process- 
ing capability is necessary for handling complicated real-time 
flight navigation, management, and control tasks. The inte- 
grated flight control and navigation system employs 
30 advanced microprocessor and parallel processing techniques 
to perform flight data processing at a high sampling rate. 

Highly accurate navigation and attitude measurements. In 
order to successfully perform a spacecraft flight mission, 
35 highly accurate navigation is essential. The flight control and 
navigation system employs AGNC’s existing fully coupled 
GPS/IMU navigation technology. Additionally, the GPS 
measurements will aid the I MU attitude determination, and 
will provide continuous and highly-accurate attitude mea- 
40 surements. 

Robustness, adaptivity and reconfigurability. Automatic 
spacecraft flight control is a very challenging problem due to 
large aerodynamic coefficient variations within a large alti- 
tude range. The flight control system must have robust, adap- 
45 five, and reconfigurable control capabilities. The flight con- 
trol system employs advanced control techniques to achieve 
these capabilities. It is robust against and adaptive to chang- 
ing flight conditions. 

Networking and serial communication capability. The inte- 
50 grated flight control and navigation system provides a net- 
working port to connect with other computer systems, and 
serial MIL 1553, ARINC 429, RS232 and/or RS422 ports to 
connect with peripheral devices. The networking capability 
allows one to connect the flight control and navigation system 
55 to a host computer, which may be used to upload data from 
and download program and/or data to the system, as well as 
debug and monitor the performance of the flight control and 
navigation system. By connecting to other measurement 
instruments onboard through serial ports, the system can use 
60 data from and send messages to these instruments. 

Low cost, lightweight and small size. Low cost, low power, 
lightweight and small size are vitally important factors in the 
development of commercial vehicle control and navigation 
systems. The integrated flight control and navigation system 
65 utilizes the latest proven hardware and software techniques, 
such as microelectromechanical (MEM), multi-layered inte- 
grated circuits, and windows and object-oriented program- 
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ming techniques, to reduce the physical size, weight, and 
manufacturing cost and enhance the maintainability and reli- 
ability. 

The integrated GNC hardware system was designed based 
on a standard 32 -bus structure, and in a modular way. FIG. 14 5 
shows the modular structure of the integrated flight control 
and navigation system. The basic modules include: 

Navigation data processing module, 

Flight management and control module, 

GPS receiver module, 10 

IMU data interface and processing module, 

Shared memory module, 

Networking adapter module, 

MIL 1553 or ARINC 429 interface module, and 
RS 232/RS 422 interface module. 15 

GPS Multipath Noise Mitigation Algorithms 

This section documents the results of the investigation into 
the charateristics of the GPS multipath noise and the multi- 
path signal mitigation algorithms. 

The GPS multipath effect is well described by its name that 20 
a GPS satellite signal arrives at the GPS receiver antenna via 
more than one path. Multipath is mainly caused by reflecting 
surfaces near the GPS receiver antenna. The International 
Space Station (ISS 2') is very large in terms of physical and 
electrical size. Its mechanical structure is also complex which 25 
forms many potential reflecting surfaces for the GPS satellite 
signals, as shown in FIG. 15. 

Multipath is the corruption of the direct GPS signal by one 
or more signals reflected from local surroundings. FIG. 16 
gives the time delay errors introduced by the multipath sig- 30 
nals. Carrier phase multipath is currently the limiting error 
source for high precision GPS applications such as carrier 
phase relative navigation and carrier phase attitude determi- 
nation. 

As a consequence, the received signals have relative phase 35 
offsets and the phase differences are proportional to the dif- 
ferences of the path lengths. There is no general model of the 
multipath effect because of the arbitrarily different geometric 
situations. However, for a certain ISS 2' configuration, the 
GPS multipath effect shows some kind of pattern. In this case 40 
the modeling and computational methods can be applied to 
predict and evaluate the multipath effects. For example, 
Lockheed Martin Space Mission Systems and Services Com- 
pany conducted a study of the computation of signal strength 
and phase errors due to multipath effects using a rigorous 45 
Computational Electromagnetics (CEM) technique called the 
Uniform Geometrical Theory of Diffraction (UTD). The 
UTD technique provides a high frequency approximate solu- 
tion to the electromagnetic fields — including incident, 
reflected, and diffracted fields as well as their interactions. In 50 
the field computation using UTD, the incident, reflected, and 
diffracted fields are determined by the field incident on the 
reflection or diffraction point multiplied by a dyadic reflec- 
tion or diffraction coefficient, a spreading factor, and a phase 
term. 55 

The model and computational methods are not suitable for 
conditions where the reflection points and the number of 
reflection surfaces are changing. The GPS multipath is a very 
complex issue which upsets accurate navigation because not 
only the mechanical structures on the ISS 2' are in motion, 60 
such as the solar panels, but the GPS satellites and the AER- 
Cam T are moving. Therefore, the computational method 
such as the UTD only provides an approach to evaluate the 
accuracy dilution of navigation arising from the multipath 
signals. 65 

The influence of the multipath can also be estimated by 
using a simple method of combination of LI and L2 code and 
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carrier phase measurements. The principle is based on the fact 
that the troposphere, clock errors, and relativistic effects 
influence code and carrier phases by the same amount. This is 
not true for ionospheric refraction and multipath which are 
frequency dependent. Taking ionospheric-free code ranges 
and carrier phases, and forming corresponding differences, 
all afore-mentioned effects except for multipath cancel out. 
The residual, apart from the noise level, is the multipath 
effect. 

The elimination of multipath signals is also possible by 
selecting an antenna that takes advantage of the signal polar- 
ization. GPS signals are right-handed circularly polarized 
whereas the reflected signals are left-handed polarized. A 
reduction of the multipath effect may also be achieved by 
digital filtering, wideband antennas, and radio frequency 
absorbent antenna ground planes. The absorbent antenna 
ground plane reduces the interference of satellite signals with 
low or even negative elevation angles which occur in case of 
multipath. 

The Phase-Lock Loop (PLL) for carrier tracking and 
Delay-Locked Loop (DLP) for code tracking can be modified 
for multipath mitigation in a GPS receiver. The characteristics 
of the phase detector in the PLL and the discriminator in the 
DLL dominate the tracking performance of the PLL and 
DLL. FIG. 17 shows the discriminator in a GPS receiver. Note 
that there is a linear region around 8=0. This region is always 
chosen as the operating region of the DLL, and the loop will 
tend to operate at the point where S(8)=0 and the slope is 
positive. The multipath effects contaminate the linear char- 
acteristics of the S-curve. The multipath forces the equilib- 
rium point to move, causing false tracking of the received 
signal. 

A bank of correlators are used to estimate the gain and the 
phase of the direct-path and reflected multipath signals. These 
parameters are then fed back into the standard non-coherent 
DLL to force the false equilibrium point due to the multipath 
to be shifted into the true point. This process is achieved in the 
discriminator by weighting the output of the correlators with 
the estimated multipath parameters such that the mathemati- 
cal summation of the correlator outputs is zero as long as the 
tracking error is zero. 

The two multipath parameters influencing the S-curve are 
the time delay a and the strength parameter A. The strength 
parameter A affects the power added to the direct path signal. 
FIG. 18 gives the modified PLL for multipath mitigation. 
Assume that the GPS signal with multipath is given by 

P=A cos^r+^oH-^) (0.1) 

The Voltage Controlled Oscillator (V CO) 1 generates a 
sine wave sin(co c t+O m ), whose input is the calculated phase 
from the estimated multipath parameters. The first multi- 
plier outputs A cos(O 0 +T> m -<|) m ). The second multiplier 
modulates this signal to the carrier frequency ou, yielding A 
cos((o c t+<D 0 +<I) m -<i) m ). 

The next step is to mitigate the effect of the multipath 
strength by multiplying the cosine signal by the estimated 
multipath amplitude^ A^/V^. The actual signal into the stan- 
dard PLL becomes A m cos(oo c t+0 0 +O m -O m ), and the local 
generated carrier phase is 


' localcarrier \ ( 0 . 2 ) 

VT sin^w c r + (pQ +(p m + (p m ) 
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where O 0 +O w -O m is the phase estimated by the PLL. This 
shows that the carrier phase tracking accuracy is dependent 
upon the estimation of the multipath carrier. The correspond- 
ing tracking curve is given by 


/ trackingcarrier \ ( 0 - 3 ) 

SmUo + <Pm-K-(pO+(pm- K) 

10 

When steady state tracking of the PLL is reached and an 
exact estimate of multipath error carrier phase is available, the 
complete alignment of the direct path signal with the local 
carrier signal is achieved. 

Laser Dynamic Range Imager Alignment 15 

The implication of using the Laser Dynamic Range Imager 
(LDRI) for the alignment of the AERCam 1' navigation sys- 
tem is to obtain the range, range rate measurements and 
orientation of the AERCam 1' when it is in the field of view of 
the LDRI. These range, range rate measurements and orien- 20 
tation data are employed together with the geometry data of 
the laser source to compare with the navigation solution and 
periodically align the AERCam l”s navigation system. 

The laser dynamic range imager (LDRI) is an area range- 
sensing instrument to obtain dynamic range measurements of 2 5 
vibrating structures on the ISS 2\ Diffuse laser light is used as 
an illumination source and its reflections are intensified and 
sensed by a video camera. The video images and phase shift 
information are post-processed to obtain range data on a 
pixel-by-pixel basis from a target in the field of view. 30 

The LDRI alignment procedure can be done whenever 
AERCam 1' is in the field of view of the LDRI. Another 
scenario is to periodically send the AERCam 1' to the field of 
view of the LDRI to perform the alignment. The second 
method is an active approach to assure the AERCam 1' navi- 35 
gation accuracy. 

Range, Range Rate and Attitude Determination Using LDRI 
The position, velocity and attitude of the AERCam 1' can 
be determined by the LDRI which is the misalignment infor- 
mation source. The alignment is done by estimating misalign- 40 
ment between the LDRI measured position, velocity and atti- 
tude of the AERCam 1’ and position, velocity and attitude 
derived by the INS navigation system onboard the AERCam 
I' through dynamic data matching. 

The geometrical configuration of the LDRI and the AER- 45 
Cam I' is given in FIG. 19. The line-of-sight (LOS) related to 
a specific laser spot on the AERCam 1' can be easily deter- 
mined through calculation of the elevation angle |3 and azi- 
muth angle a as follows: 

^=arctg(YA^X 2 +F 2 ) 
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denoted by \p [ISS] or in the F AE R C am r frame, denoted by 
[AERCam-]' In t]l Q LDRI alignment, the ISS 2’ orientation 
relative to the navigation frame F„ is assumed to be known 
and used as a reference. Even under the condition of perfect 
alignment, the computed orientation of the AERCam 1' (on- 
board IMU) differs from the actual orientation due to various 
errors in measurements and computations. Given the trans- 
formation matrices from the ISS 2' frame F/SS 2 ’ and the 
AERCam 1' frame F AERCa m r t0 the navigation frame F w and 
C nISS 2 ' and C nAERCam r , respectively, the misalignment from 

^ AERCam V t° ^ISS 2' 


C ISS/ AERCam — C ISSnCnAERCam 


\ _ljj[AERCam\ ^[AERCam] 

^[AERCam] j _^[AERCam] 

_^[ AERCam] ^[AERCam] ^ 

J + ^[AERCam] x] 


(0.2) 


It can be seen that, when ^ AERCam ^=Q in Equation (6.2), the 
two frames are perfectly aligned. 

In transfer alignment, the ISS 2' orientation relative to the 
navigation frame is assumed to be known and used as a 
reference. The orientation of the AERCam 1' IMU relative to 
the navigation frame is computed using the attitude update 
equation shown in Equation (6.3) from an initial orientation 
and the gyros’ outputs. The evolution of the attitude of the 
body-fixed frame F^ relative to the navigation frame F n can be 
expressed as 


-j- t (Cnb) = C nb [Jff n X] 


(0.3) 


where 

C w6 =transformation matrix from body frame F b navigation 
frame F„ 

connotation rate of body frame F b relative to navigation 
frame F n referenced in F b 
x=vector cross product. 

The vector cross product in Equation (6.3) can be repre- 
sented in the form of skew symmetric matrix 



-° J z 

0 


~OJy OJ X 


OJy 

-OJ x 

0 


(0.4) 


a=arctg(X/F) (0.1) 

where (X, Y) are the coordinates of the laser spot in the X-Y 
plane of the 3-D image taken by the LDRI and F is the focal 
length of the LDRI. 

The LDRI also detects precisely the range related to a point 
on the AERCam 1', which corresponds to the third dimension 
of the 3-D image of the AERCam 1'. The coordinates of a 
point on the AERCam 1' thus can be determined using the 
range measurement and the LOS angles given in Equation 
6.1 . The attitude of the AERCam 1' can be derived from the 
range profile image taken by the LDRI. 

Optimal LDRI Alignment Filter 

The physical misalignment between the ISS 2' frame ^ ISS 2' 
axes and the AERCam 1* frame F AERCam 1 , axes can be chara- 
terized by a small angle expressed either in the ^ISS 2’ frame, 


where co 6 /w [ 6 ] =[tt) x , co,,, coJ r The transformation matrix C„ b in 
Equation ( 6 .3) can be parameterized in three alternative ways : 
55 with 9 elements as the direction cosine matrix; 
with 4 elements as a rotation quaternion; 
or with 3 Euler angles. 

The AERCam 1* IMU transformation matrix is initialized 
using that of the ISS 2' IMU. That is, at time t=0, 

60 

C AERCam *n (^)C/sS/AERCamn(^) =( ^AERCam*ISs(^) = ^ (0-5) 

After the initial time, 


65 


C AERCam *n ( 0 ^ ISSrSf)~^ AERCam *m ( ? )“ 

I-[^ } AERCam \t)x\, tyV£Rc™] =0 


( 0 . 6 ) 


where ^J. AERCam ~\ denotes the small angle by which the com- 
puted frame F AERCam r * will drift away from F ISS1 - This drift 
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is attributed to the effect of the physical misalignment if L AER _ 
cam], sensor noise, and others. Note that this attitude 
difference t|) i^ERCam] - g measura bl e an d can be obtained by 

[^} AERCam Xt)x\=I-C s * n {t)C mn (t) ( 0 . 7 ) 

where C s * n and C nm are provided by the attitude computation 
of the ISS 2' IMU or navigation system and the AERCam 1* 
IMU, respectively. 

The evolution of the attitude difference between the com- 
puted IMU frame F A ERc am r* an d the master frame F ISS 2 . is 10 
obtained by differentiating Equation (6.7) as 

[ty} AERCam ^(t)x\ =-L AE R Cam *n ^nISS~ ^AER Cam *t J-'nISS ( 0 . 8 ) 

Bringing into Equation (6.8) the rates of transformation 
matrices as given in Equation (6.3) neglecting products of 15 
small angles, gyro drift rates, and flexible body rates leads to 
the following equation 

L^™MxJ=L (0 ' 9) 20 

L^ssi„ Cam] xj + l*. X “" 1 X] - [(#. x W 'S) X] 
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a/s/^^latform acceleration in the ISS 2' IMU frame 
g /5S . [ ” ] =gravity vector in the navigation frame 
Similarly, the navigation solution provided by the AER- 
Cam 1’ IMU is 


^ [n] _ n A AERCatn] 

~j~ V AERCam ~ L nAERCam * a AERCam + 


( 0 . 14 ) 


g^RCatn ~ {0$ + <$)* ^ERCatn ~ 4/1 X ft# X 


where 

v ^E«cam C ” ]=eart h-centered velocity in the navigation 
frame provided by the slave IMU 
^AERCam^ AERCam ^ =meSLSUre( ^ acceleration in the AERCam 
T IMU frame 

% AERcam [w] =gravity vector in the navigation frame esti- 
mated by the slave IMU 

From Equations (6.13) and (6.14), the AERCam l'-minus- 
ISS 2' velocity difference is propagated according to 


where iO AER cam/n ^ AER Cam ^ i s the computed angular rate of 
F AERCam r relative to F„ referenced in F AERCam r . 25 

The computed AERCam 1' IMU rotation rate 
^Ajrncam/„ lAERCam] can be written as 


^ [AERCam] _ * [AERCam] [AERCam\ 
^ AERCam jn ~ ^ AERCam/i ^n/i 


(0.10) 30 


[ AERCam ] AAERCam] , \AERCam ] _ [ AERCam ] , [. AERCatn] 

^ AERCatn/ i + £ g ~ 0J n/i ~ w AERCam/n + £ g 


d . [ n ] [n] , _ n A [ AERCam ] 

AERCam ~ V ISS) ~ L nAERCam * a AERCatn ~ 


( 0 . 15 ) 


Cniss * a\ss 1 ~ ( W n/1 + <4/1 ) X (^AERCatn ~ V /Ss) 


where an identical gravitational compensation for the ISS 2' 
and AERCam T systems is assumed so that the ISS 2' and 
AERCam 1' gravitational effects cancel perfectly. 

The AERCam T-sensed acceleration is given by 


where o) AKR Cam/i Cam ^ is the actual rotation rate in the 
input axes of the gyros and € J- AERCam l the AERCam 1' gyro 
errors resulting from instrument imperfections. 

Bringing the expression for (ti AER cam/n ^- AERCam ^ into Equa- 
tion (6.8), neglecting products of small angles and gyro drift 
rates yields 

^AERCatn] y j = ^ERCatn] x] + ^[AERCatn] x ( 0 . 1 1 ) 

x] - x&^sd x] 

or 

^[AERCatn] _ AERCam | x + £ [AERCam] ? ^[AERCatn] ^ _ q ( 0 . 12 ) 

From the above equation we can see that the AERCam 1’ 
frame is driven by the gyro instrument errors ^\ AERCam \ to 
drift away from an initial orientation under the assumptions of 
no physical misalignment and zero initial misalignment. 

There is also a discrepancy between the LDRI derived 
AERCam 1* velocity and the velocity sensed by the acceler- 
ometers. This information can also be used for the correction 
of the AERCam 1' navigation system. 

The navigation solution provided by the ISS 2' IMU is 


- CnissJ^ + - (4”! + 4”! ) x v S - 4*1 x <4”! x /? [n] 


where 

v /5S . c ” ] =earth-centered velocity in the navigation frame 
provided by the ISS 2’ IMU 


( 0 . 16 ) 


where a A E RCa m AERCam ^ * s the actual acceleration in the input 
axes of the accelerometers and ^l AERCam '\ j s the AERCam 1* 
accelerometer errors due to instrument imperfections. 
Finally, the velocity error equation is given by: 


= c nlAERCam ^™ c ^ xa“ ] + c nlAERCam #** c ™' 


The system model of the optimal LDRI alignment filter is 
45 given in Table 0.1. 

Table 0. 1 System Model 

The state vector for the complete system is chosen as 
follows (the definitions are also given in Error! Reference 
source not found.). There are six states characterizing the 
50 velocity and attitude errors, i.e., three for Au and three for i]u ? , 
respectively. The choice of states for inertial sensors depends 
on whether the sensor dynamic characteristics and error 
parameters are included or not. 

The use of sensor error parameters as states provides a way 
55 to calibrate the sensors through Kalman filtering . The number 
of states required to model inertial sensor errors varies con- 
siderably and depends on the sensor quality and accuracy 
requirement. A generic sensor model is used in the current 
formulation such that it can fit a large range of applications 
60 and serve multiple purposes. There are twelve states for gyros 
(three for bias, three for scale factors, and six for sensor linear 
alignment errors) and twelve states for accelerometers (three 
for bias, three for scale factors, three for sensor axes nonor- 
thogonalities, and three states for acceleration- squared non- 
65 linearities along and across the input axis). 

The optimal Kalman filter is given in Error! Reference 
source not found. 
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Stereo Camera Range Algorithm 

The stereo images generated by the dual cameras 71 
installed on board the AERCam 1' are used to estimate the 
range and the orientation of the ISS 2* relative to the AERCam 
1'. FIG. 20 shows the functional flow of this image processing 5 
subsystem. 

Denote the images obtained synchronously from the two 
cameras 71 as E 1 (x,y) and E 2 (x,y). E^y) and E 2 (x,y) rep- 
resent the same physical scene from different viewing angles. 

A correlation operation between these two images is taken to 
find point correspondences of two stereo images, and further 
to fix the intercept angle a. The intercept angle a is defined as 
the angle between the bores ight from camera 1 to the object 
and the boresight from camera 2 to the object. This correla- 
tion-based algorithm is given by: 

A (<!>) =E i (x,y) (x) [R(ty)E 2 (x,y)], (j)G[,jr) (0.1) 

where R(4>) is the rotation transformation implemented to the 
image E 2 (x,y, and (|) is the rotation angle. The cross -correla- 
tion function given by the above equation is a function of the 
rotation angle (|). The discrimination rule for the intercept 
angle a determination is given by 

a = max [A(y>)] 
tpe.[ 0,n) 

In other words, a is this angle (|) that maximizes A((|>) over 
the given range of (|>. Once the intercept angle a is fixed, the 
range from the sensor to the object can be derived according 
to the prior geometric knowledge of the separation distance 
between the two video cameras 71. 

Additionally, feature matching -based range and orienta- 
tion determination may also be performed. FIG. 21 gives the 
image feature extraction algorithm useful in this approach. 
Attributed Graph Matching Algorithm 

One example of a sophisticated feature matching and scene 
registration technique that has been successfully applied to 
related applications is attributed graph matching. Attributed 
graphs are represented by nodes and arcs where each node 
corresponds to a derived image feature and arcs represent the 
relationships between nodes. For example, in FIG. 22, a 
sensed image consists of three objects (1,2,3) containing cer- 
tain spatial relationships and attributes (size, thickness, tex- 
ture). An attributed graph can be formed from these three 
detected features as shown in FIG. 23 . The nodes of the graph 
correspond to the three individual detected features and the 
relations between nodes correspond to their angle of intersec- 
tion or spatial relationships (above, to the right of, etc.). 
Nodes also contain attributes such as the size, thickness or 
texture associated with the detected image features. 

The basic matching process requires the creation of a ref- 
erence attributed graph from available sources (example, 
information regarding the main spacecraft) and synthesizing 
a sensed attributed graph from the live sensor imagery. These 
comparable representations are then matched using a special- 
ized search algorithm. The matching or graph registration 
procedure is shown in FIG. 24. The output of the attributed 
graph matching algorithm is the largest common subgraph 
which represents the degree of match between the reference 
and sensed data. The number of nodes and arcs in the output 
attributed graph can be used to assess the match quality, based 
on the number of nodes and arcs matched, and the uniqueness 
of their corresponding attributes. Moreover, the orientation, 
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range (triangularization) and range rate (variation of matched 
features over time) of the robot relative to the main spacecraft 
can be estimated from the matched data. 

The attributed graph matching algorithm shown in FIG. 24 
uses a branch and bound technique to rapidly match the 
sensed and reference graphs. The process is mathematically a 
polynomial time algorithm. However, the attributes of the 
nodes and arcs in the graph collapse the search space and the 
registration can be easily performed in real time. The time 
consuming portion of the process is the feature extraction step 
where pixel data is processed to detect the objects in the 
sensed scene. Careful consideration should be given to the 
implementation of the feature extraction functions in hard- 
ware to satisfy throughput, thermal and volume constraints. 
Intelligent Robust Multi-Sensor Failure Detection and Isola- 
tion 

Basic Neural Network Architecture 

For a redundant sensor set, it is possible to reconstruct one 
or more lost sensor data if the relationship among the sensors 
is known. Usually, the relationship can be described as math- 
ematical equations with sensor measurements as variables. If 
an incorrect measurement occurs, there will be inconsistency 
among these equations. 

An auto-associative neural network is a neural network that 
has a unit overall gain, which means that its output vector is 
set to match its input under normal operation. The proposed 
auto-associative neural network shown in FIG. 25 has four 
hidden layers for information compression and data regen- 
eration. The redundant sensor information will be com- 
pressed, mixed and reorganized in the first part of the network 
(the first and second hidden layers). The compressed infor- 
mation represents the essential characteristics of the process 
with a smaller set of neurons. By a reason similar to that of 
majority voting, an input that contains faulty information will 
be discounted in the process. The compressed information is 
then used to regenerate the original data in the second part of 
the process (the third and fourth layers). It should be empha- 
sized that the minimum number of the nodes in the threshold 
layer in the middle of the neural network represents the 
degrees of freedom (i.e. minimum number of sensor measure- 
ments required in order to regenerate all sensor estimates) of 
the redundant sensor group . In the data regeneration layer, the 
compressed information represented by the middle layer neu- 
rons is used to generate the original input data. 

The objective of the auto-associative neural network train- 
ing is to generate good sensor estimates for all sensors even 
though some of the sensor measurements have been cor- 
rupted. In order to make the neural network perform the 
desired mapping from the input layer to the output layer, one 
usually searches for the optimal connection weights between 
the neurons to approximate the desired mapping by training 
algorithms. The most popular training algorithm for feedfor- 
ward networks with sigmoid activation functions is the back- 
propagation algorithm, which is used to adjust the weights of 
the network so that the network output will return the desired 
sensor measurements for both normal data sets and corrupted 
sensor sets. One of the most important objectives in the neural 
network training is to isolate a sensor estimate from its cor- 
responding input. In other words, a failed sensor on the net- 
work input should not have any more impact on the corre- 
sponding network output than others. The failure isolation by 
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the neural network is achieved by blocking out, during the 
training, the weights directly connected to the failed sensor in 
the network input. 

As the backpropagation algorithm is a steepest descent 
method, it has the disadvantage of converging very slowly 5 
and being vulnerable to getting caught in local minima. To 
overcome these disadvantages, a so-called momentum term 
can be included to slide over small minima in the error sur- 
face, and the training time is shortened by the use of an 
adaptive learning rate. 

The backpropagation with momentum is expressed math- 
ematically: 

( 0 . 1 ) 

where m c is the momentum constant, lr is the adaptive learn- 
ing rate. 

Sensor Failure Detection and Replacement 

The detection of a sensor failure is done by comparing the 
neural network outputs with its corresponding inputs. A 2 o 
threshold is selected for each sensor to initiate the sensor 
failure algorithm. If the differences of the other sensors with 
their respective estimates stay relatively low, then the sensor 
measurement is declared faulty. 

Once a faulty sensor measurement is detected, it will be 25 
disconnected from the input layer of the network for the 
purposes of isolating the false information. However, the 
neural network will continue to function by using the most 
recent corresponding output which is a good estimate of the 
failed sensor measurement. Also, if the sensor measurement 30 
is used in the navigation fusion algorithm, the navigation 
system will switch to the estimated value to continue the 
system operation. Under this scheme, the system can remain 
operable even with multiple sensor failures. 

Training of Neural Network and Simulation Evaluation 
In order to ensure proper training of the neural network and 
to achieve the necessary accuracy required by the fusion 
algorithm, the following steps are taken: 

Training data are generated by applying a 6DOF trajectory 40 
data. 

The data generated are carefully screened to select a uniform 
data set across the range of interest, and 
Repeated training of the neural network by randomly 
selecting a data set, randomly failing a sensor reading, and 45 
using the back-propagation to adjust the weights, forces the 
outputs of the network to closely match the desired inputs. 

For carrying out the training of neural networks and the 
closed-loop simulation evaluation, the following work shall 
be performed: 50 

Selection of the number of hidden layers of the autoassocia- 
tive neural network. 

Generation of training data. 

Off-line network training. 

On-line simulation evaluation. 

Trajectory Generation for the AERCam 1' 

The trajectory data of the AERCam 1' will service the 
follow-on research activities, such as multi-sensor simula- 
tion, navigation algorithm evaluation, collision avoidance 6Q 
guidance algorithm development and evaluation, as well as 
hardware-in- the-loop (HIL) simulation and test for the AER- 
Cam l”s autonomous multi-sensor based relative navigation 
and collision avoidance system. 

Clohessy- Wiltshire (CW) Equations 65 

If we just release the AERCam 1' from the ISS 2 f it will 
move freely. It will change orbit so that if we put the AERCam 


1' at one end of the ISS 2’, after 45 minutes, it will be at the 
other end. To effect the dynamics of the AERCam V we must 
have the equations of motion of the AERCam 1' within the 
proximity of the ISS 2* with velocity and in coordinates origi- 
nating from the ISS 2'. A right-handed (x,y,z) system was 
chosen with y in the direction of the radius from the earth’s 
center to the mass center of the ISS 2' and with z in the 
direction of the rotation vector for the ISS 2', i.e. perpendicu- 
lar to the plane of the ISS 2' orbit and in the direction of its 
angular momentum. The x axis lies along the tangent to the 
ISS 2 ' orbit and positive x is in the direction counter to the ISS 
2”s direction of motion. 

The equations of motion of the AERCam V are given, in 
this coordinate system, by: 


r x 2 

— -x — 2wy - w x 
m 

f 

— = y + 2wx — w*(y + ro) 
m 



The F x , F y , and F z contain gravitational forces and perhaps 
thrust. By introducing the gravitional forces and expanding 

the gravitational terms in powers of Vx 2 +y 2 +z 2 /r 0 , and denot- 
ing the thrust vector as [T x , T , TJ r , the equations now 
become 


T x 

— = x - 2wy 
m 

T 

— = y + 2wx — 2w 2 y 
m 


r z 2 

— = t + W Z 
m 


(0.2) 


Under the assumption of T x =T^=T z =0, the solution is given 
by 


x = 2l 


(2xq 


3_y 0 sinwr ■ 


2^0 


coswr + (6w;y 0 - 3±o )t + *o -* 




■£-*) 


|coswr + — sinwr + 


h-S) 


Z = zocos wt-\ sinwr 


(0.3) 


where x 0 , y 0 , z 0 , x 0 , y 0 , z 0 are initial values of position and 
velocity of the AERCam 1*. Equation z shows that the AER- 
Cam 1* performs simple harmonic motion in the z direction. 
AERCam 1' Trajectory Generation Scheme 

According to this invention’s requirements we do not need 
an absolute AERCam 1' trajectory for navigation algorithm 
development and validation. There is a need for a precision 
relative trajectory with respect to the International Space 
Station (ISS 2') for navigation algorithm development. There- 
fore a trajectory of the AERCam 1' was generated as a small 
purturbation of the ISS 2* trajectory for this invention. The 
sophisticated trajectory generation can use Clohessy- Wilt- 
shire (CW) formulation to include the AERCam l”s dynam- 
ics. The ISS 2' trajectory may be obtained from the orbital ISS 
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2' model and measurements, and the AERCam 1' dynamic 
model may be derived using a technique similar to that shown 
below for the ISS 2'. 

The AERCam 1' is a small free-flying unmanned platform 
capable of teleoperation and autonomous flight in close prox- 5 
imity to the ISS 2’. It will be able to hold position (station 
keeping) relative to, or to fly trajectories about its target. The 
trajectory of the AERCam 1’ in the Earth-Centered-Earth- 
Fixed (ECEF) coordinate system is related to the trajectory of 10 
the ISS 2'. In addition, the relative trajectory of the AERCam 
1' with respect to the ISS 2’ is a low-dynamics process with 
low- speed motion and slow change in relative position. Based 
on these considerations, we figured out the AERCam 1' tra- 
jectory generation scheme as follows: 15 

Step 1 : Generate a standard six-degree-of- freedom 
(6-DOF) trajectory in ECEF coordinate system for the ISS 2'; 

Step 2 : Generate a relative trajectory with respect to the ISS 
2' for the AERCam 1'; 

Setp 3 : Merge the ISS 2' trajectory in the ECEF system and 20 
the AERCam T’s relative trajectory to obtain a trajectory of 
the AERCam 1 ' in the ECEF system. The traj ectory data in the 
ECEF coordinate system can be easily transformed into that 
in the ECI (Earth Centered Inertial) coordinate system to 
meet the HIL simulation requirements. 

The AERCam l”s relative trajectory can be used for evalu- 
ating the relative navigation solution and developing the col- 
lision avoidance algorithm. The AERCam l”s trajectory in 
the inertial system can be used for navigation sensor valida- 30 
tion and simulation, including the GPS receiver and the IMU. 

Since the current objective is to develop a reasonable truth 
reference trajectory for the AERCam 1' navigation system 
eveluation, we neglect the orbital effects of the relative ISS 


qjb = 


p 

q 


r 


(0.7) 


The Earth’s rotation expressed in ISS 2' body axes is 



Pb' 


cosA 

->E 
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= Lev 
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-sinA 


a Cb is expanded to give 


a c =u+(q+q E B )w-{r+r E B )v 


a c =v+(r+i£ B )u-(p+pF B )w 


a c =w+(p+p^ B )v-(q+cf B )u (0.9) 

With the jet thruster force in body axes denoted by 



(0.10) 


in accordance with traditional usage, and treating gravity in 
the ISS 2* body axes as 


8b ~ 




cos0cosi/r cos#sini/f —sin# 

0‘ 

= 

sin^sin#cos^ - cos^sin^ sin0sin#sin^ + cos^cos^ sin^cos# 

0 


cos0sin#cos^ + sin^sint/f cos0sin#sini/f - sin^cost// cos^cos# 



( 0 . 11 ) 


2'-AERCam 1' motion for now. We assume sufficient AER- 
Cam T fuel supply to maintain its desired station with respect 45 
to the ISS 2’. 

Step 1 : Formulation of the ISS 2' Trajectory Generation 

The force equation of motion of the ISS 2' in body axes F^ 
is 50 

J B =ma CB (0.4) 

where, a Cb is given by 

~a c b = ^ E b+(^b+ v> E B )xf E B (0.5) 

The scalar components of the vectors of the above equation 
are 


the force equation (9.4) becomes: 

X-mg sin Q=m[u+(q+q E B )w-(r+r E B )v] 

Y+mg cos 0 sin <fy=m[v+(r+r E B )u-(p+p E B )w] 

Z+mg cos 0 cos ty = tn[w+(p+p E B )v-(q+q E £ )u] (0.12) 

Correspondingly, the moment equation due to jet thruster 
in body axes is 
55 

^B = ^sAl = ^. B +(a B x ^B (0.13) 

The conventional notation for (j b (jet thruster moments) 
60 and h B (angular moments) is 


—,E 

Vr = 


’ u ' 

(0.6) 
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h B = 


h x 

hy 

K 


The resulting ISS 2’ moment equation in body axes is 


^=^4< x (^-p 2 )-i xy (p+qr)-iy^-pq)<h-Qrp 


N^J^I^-^-IyM+rpyiJp-qry^-I^pq 


One skilled in the art will understand that the embodiment 
of the present invention as shown in the drawings and 
described above is exemplary only and not intended to be 
limiting. 

5 It will thus be seen that the objects of the present invention 
have been fully and effectively accomplished. It embodi- 
ments have been shown and described for the purposes of 
illustrating the functional and structural principles of the 
present invention and is subject to change without departure 
10 from such principles. Therefore, this invention includes all 
modifications encompassed within the spirit and scope of the 
following claims. 

(0.15) 


Based on the force equation (9.12) and the moment equa- 15 
tion (9.1 5), the ISS 2”s six-degree-of- freedom trajectory data 
was generated. 

Step 2: Relative Trajectory Generation for the AERCam 1* 

We have to consider the AERCam l”s dynamic model 
when executing efforts to generate the traj ectory for the AER- 20 
Cam I'. FIG. 25 shows the features of the AERCam 1' II. FIG. 

9-2 provides the AERCam l”s thruster jet model. 

The minimum thruster duty cycle is 0.004 seconds, and the 
jet force is 0.085 lbf. The jet locations (x,y,z) [meters] are: 
jetl=[-0.1 143; 0.0000; -0.1016]; 25 

jet2=[-0.1 143; 0.0000; 0.1016]; 
jet3=[0.1 143; 0.0000; -0.1016]; 
jet4=[0.1 143; 0.0000; 0.1016]; 
jet5=[-0.1016; -0.1143; 0.0000]; 

jet6=[0.1016; -0.1 143; 0.0000]; 30 

jet7=[-0.1016; 0.1 143; 0.0000]; 

jet8=[0.1016; 0.1143; 0.0000]; 

jet9=[0.0000; -0.1016; -0.1143]; 

jetl0=[0.0000; 0.1016; -0.1143]; 

jetl 1=[0.0000; -0.1016; 0.1143]; 35 

jetl2=[0.0000; 0.1016; 0.1143]; 

The jet thrust direction unit vectors are: 
jetl =[1.0000; 0.0000; 0.0000]; 
jet2=[1.0000; 0.0000; 0.0000]; 

jet3=[- 1.0000; 0.0000; 0.0000]; 40 

jet4=[- 1.0000; 0.0000; 0.0000]; 

jet5 =[0.0000; 1.0000; 0.0000]; 

jet6=[0.0000; 1.0000; 0.0000]; 

jet7=[0.0000; -1.0000; 0.0000]; 

jet8=[0.0000; -1 .0000; 0.0000]; 45 

jet9=[0.0000; 0.0000; 1.0000]; 

jetl0=[0.0000; 0.0000; 1.0000]; 

jetl 1=[0.0000; 0.0000; -1.0000]; 

jetl2=[0.0000; 0.0000; -1.0000]; 

The AERCam 1* CG offset (x,y,z) [inches] is [0.332, 0.224, 50 

0.165]. The inertia matrix [lbm kT2] is 
I=[539.1, -14.7, 13.6; 

-14.7, 570.7,21.9; 

13.6,21.9, 531.4] 

Consequently, FIG. 26 is a sample relative trajectory of the 55 
AERCam 1* with respect to the ISS 2'. 

The coordinate system used for relative trajectory genera- 
tion is the ISS 2' body axes, which are defined as: 

Origin is at the ISS 2”s center of mass (COM). 

Xb-axis points along the ISS 2”s longitudinal (fuselage) 60 
axis (called the roll axis). 

Yb axis points out to the right side of the ISS 2' (called the 
pitch axis). 

Zb axis points down. 

The corresponding trajectory in the ECEF coordinate system 65 
of the AERCam 1' is given in FIG. 27. Table 4 gives the 
trajectory parameters. 


What is claimed is: 

1. A method of three dimensional positioning of objects, 
comprising the steps of: 

(a) injecting raw measurements from two or more sensors 
into a data fusion system to derive relative position and 
attitude information of objects; 

(b) tracking at least four common GPS (Global Positioning 
System) satellites simultaneously by means of AERCam 
(autonomous Extravehicular Activity Robotic Camera) 
1' and ISS (International Space Station) 2'; 

(c) optimally blending multipath signal and GPS signal due 
to any intermittently fail of relative GPS -alone when 
said AERCam 1' maneuvers into a proximity of said ISS 
2* because of occasional strong multipath signal and 
GPS signal blockage with IMU data including gyro and 
accelerometer measurements; 

(d) initializing an inertial navigation system when a GPS 
solution is available and using said GPS solution; 

(e) tracking position and attitude of said AERCam 1' rela- 
tive to said ISS 2' by said inertial navigation system in 
close proximity; 

(f) estimating and resetting frequently for errors of said 
inertial navigation system growing with time; 

(g) aiding said inertial navigation system during close 
proximity operation with available GPS signals and at 
least two cameras installed on said AERCam 1* to main- 
tain accurate relative navigation, wherein range and 
range rate between said AERCam 1' and said ISS 2' are 
blended in multi-sensor fusion algorithm to compensate 
for IMU sensor drifts during GPS outage or unreliable 
GPS data; and 

(h) imaging said ISS 2' by at least two cameras installed on 
said AERCam 1' for images which are further processed 
via correlation and coordinate transformations tech- 
niques to derive range and range rate on-board of said 
ACRCam 1* for image parameters which are able to be 
computed and transmitted said range and range rate back 
to said AERCam 1'. 

2. The method, as recited in claim 1, wherein, in the step 
(c), three accelerometers and three gyros are used in a multi- 
sensor based navigation system to provide three-dimensional 
position and attitude solutions. 

3. The method, as recited in claim 1, further comprising a 
step of performing intelligent failure detection and isolation 
for multiple disparate navigation sensors by using one or 
more neural networks and generate filtered sensor estimates 
for said sensors even though some of the sensor measure- 
ments have been corrupted by noise, disturbances or failures. 

4. The method, as recited in claim 3, wherein said neural 
network has four hidden layers for information compression 
and data regeneration and is trained to generate said filtered 
sensor estimates. 
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5. The method, as recited in claim 4, further comprising a 
step of determining continuously coordinates with respect to 
an unknown point by means of a MEMS coremicro IMU 
supporting said AERCam 1*. 

6. The method, as recited in claim 5, further comprising a 5 
step of obtaining accurate positioning with said GPS by using 
of carrier phase observables. 

7. The method, as recited in claim 6, further comprising a 
step of mitigating a potential impact on accuracy of said 
MEMS coremicro IMU via smart integration algorithms with 10 
navigation sensors, including rate sensors and accelerom- 
eters, wherein sources of said rate sensors and accelerometers 
have been sought out and characteristics of said rate sensors 
and accelerometers are obtained so that models of said 
MEMS coremicro IMU are able to be generated for Simula- 15 
tions of said AERCam 1', including sensor biases, drift rates, 
response times, and noise sources. 

8. The method, as recited in claim 1, further comprising a 
step of aiding acquisition and tracking of GPS signals by said 
inertial navigation system to extend dynamics thereof while 20 
maintaining a minimum tracking loop bandwidth. 

9. The method, as recited in claim 8, further comprising a 
step of providing mechanics of using GPS solution to aid said 
inertial navigation system and using inertial navigation sys- 
tem solution thereof to aid code and carrier tracking of a GPS 25 
receiver. 

10. The method, as recited in claim 9, wherein said GPS 
receiver provides raw pseudorange and carrier phase observ- 
ables for an integrated navigation Kalman filter and a syn- 
chronous timing signal for date sampling electronics of said 30 
MEMS coremicro IMU, wherein IMU instrument errors are 
corrected in said integrated navigation Kalman filter and said 
IMU electronics. 

11. The method, as recited in claim 10, wherein said GPS 
receiver accomplishing identification of all visible satellites 35 
with calculation of geometric dilution of precision, measure- 
ment of satellite-to -receiver pseudoranges and decoding of 
navigation messages, delivery of data to a navigation micro- 
processor, and receiving of velocity and acceleration aiding 
data from said integrated navigation Kalman filter to perform 40 
external aiding, carrier phase and code tracking. 

12. The method, as recited in claim 11, wherein an absolute 
AERCam 1' trajectory is not needed for navigation algorithm 
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development and validation while a precision relative trajec- 
tory with respect to said ISS 2' for navigation algorithm 
development is needed, wherein said trajectory of said AER- 
Cam 1' is generated as a small perturbation of said ISS 2' 
trajectory. 

13. The method, as recited in claim 12, wherein a sophis- 
ticated trajectory generation is able to use Chohessy- Wilt- 
shire formulation to include dynamics of said AERCam 1', 
said trajectory of said ISS 2’ is able to be obtained from orbital 
ISS 2' model and measurements. 

14. The method, as recited in claim 13, wherein said AER- 
Cam 1' is a small free-flying unmanned platform capable of 
teleoperation and autonomous flight in close proximity to 
said ISS 2', which is able to hold position relative to fly 
trajectories about a target thereof, wherein said trajectory of 
said AERCam 1' in an Earth-Centered-Earth-Fixed (ECEF) 
coordinate system is related to said trajectory of said ISS 2', 
wherein a relative trajectory of said AERCam 1' with respect 
to said ISS 2' is a low-dynamics process with low-speed 
motion and slow change in relative position. 

15. The method, as recited in claim 14, further comprising 
the steps of: 

generating a standard six-degree-of-freedom (6-DOF) tra- 
jectory in said ECEF coordinate system for said ISS 2'; 

generating said relative trajectory with respect to said ISS 
2' for said AERCam 1'; and 

merging said trajectory of said ISS 2' in said ECEF coor- 
dinate system and said relative trajectory of said AER- 
Cam 1' to obtain said trajectory of said AERCam 1' in 
said ECEF coordinate system. 

16. The method, as recited in claim 15, further comprising 
a step of transforming trajectory data in said ECEF coordinate 
system into an Earth Centered Inertial coordinate system to 
meet HIL simulation requirements. 

17. The method, as recited in claim 15, wherein said rela- 
tive trajectory of said AERCam 1' is used for evaluation 
relative navigation solution and developing collision avoid- 
ance algorithm and said trajectory of said AERCam 1' in said 
inertial navigation system is used for navigation sensor vali- 
dation and simulation, including said GPS receiver and said 
MEMS coremicro IMU. 



